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Appendix  9 
Sentinel  Effects  of  ORT 

The  principal  effects  of  most  law  enforcement  efforts  are  typically  not  on  those  individuals  or 
organizations  who  are  investigated,  charged,  or  convicted  of  wrongdoing.  A  primary  function  of  law, 
from  an  economic  perspective,  is  to  alter  incentives.  In  the  economic  model  of  criminal  behavior,  an 
individual  commits  a  crime  because  the  expected  benefits  from  the  crime  exceed  the  expected  costs  (which 
include  the  opportunity  cost  of  the  criminal's  time  and  the  expected  costs  of  crimmal  punishment). 

Previous  empirical  studies  have  shown  that  criminals  respond  to  changes  in  the  probability  of 
apprehension  or  the  severity  of  punishment.  Changes  in  the  prospect  of  detection  or  prosecution  associated 
with  ORT  may  have  deterred  some  potential  wrongdoers  from  attempting  to  defraud  the  Medicare  program 
in  the  first  place.  The  change  in  behavior  that  occurs  due  to  the  increased  likelihood  of  detection  is  termed 
the  "sentinel  effect"  of  the  program. 

Sentinel,  or  deterrence,  effects  are  an  important,  potentially  large,  indirect  source  of  ORT  savings.  They 
arise  from  events  (e.g.,  the  submission  of  fraudulent  or  abusive  Medicare  claims)  that  did  not  actually 
occur,  but  presumably  would  have  occurred  in  the  absence  of  ORT.  As  a  result,  the  total  savings  to  the 
Medicare  Trust  Fund  resulting  from  ORT  may  be  far  greater  than  the  value  of  actual  monetary  recoveries 
from  01  cases  (e.g.,  due  to  fines,  overpayment  recoveries,  settlements,  restitution,  or  judgements)  or 
overpayments  identified  by  OAS  audits. 

In  the  sections  that  follow,  we  first  describe  our  approach  to  measuring  potential  sentinel  effects,  and  then 
present  our  analyses  in  three  service  areas:  home  health,  durable  medical  equipment  (DME),  and  skilled 
nursing  facilities. 

9.1    Outcome  Measures,  Data  Sources,  and  Estimation  IVIethods 

Because  sentinel  effects  arise  from  events  (i.e.,  fraud  and  abuse  of  the  Medicare  program)  that  did  not 
actually  occur,  they  are  difficult  to  quantify  and  to  measure.  Our  general  approach  for  estimating  sentinel 
effects  is  based  on  the  assumption  that  fraud  and  abuse  are  more  like  to  be  reduced  in  geographic  areas 
and  types  of  service  where  ORT  enforcement  activity  is  most  concentrated. 

Because  it  is  not  possible  to  directly  measure  the  volume  of  fraud  and  abuse  from  HCFA  claims  data,  we 
estimate  sentinel  effects  indirectly,  by  examining  MSA-level  changes  in  cost  and  utilization  patterns  over 
time. 

9.1.1     Outcome  Measures 

The  first  problem  in  estimating  sentinel  effects  is  determining  where  to  look.  In  deciding  which  analyses 
to  perform,  we  faced  a  trade-off  between  broadly  and  more  narrowly  defined  outcome  measures.  It  is  not 
appropriate  simply  to  take  trends  in  the  aggregate  of  all  claims  for  services  and  look  for  declines  in  key 
quantities  or  costs.  These  vary  across  geographic  areas  for  many  reasons,  including  differential 
frequencies  of  provider  fraud  and  abuse,  and  it  is  not  possible  to  differentiate  such  effects  from  other 
sources  of  variation. 
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Narrowly  defined,  very  specific  "tracer"  measures,  based  on  specific  types  of  service  that  were  the  focus 
of  individual  ORT  projects,  are  most  likely  to  show  sentinel  effects,  as  any  effects  that  resulted  from  the 
projects  are  not  as  likely  to  be  lost  among  the  many  other  sources  of  variation  in  costs  and  utilization.  The 
tracer  measures  described  below  were  developed  based  on  site  visit  discussions  with  OIG,  HCFA,  and 
AOA  staff  involved  in  ORT  and  from  ORT  project  descriptions.  They  represent  service  or  geographic 
areas  believed  to  have  high  levels  of  fraud  and  abuse. 

Narrowly  defined  outcome  measures  are  not  able  to  detect  the  substitution  of  providers  from  one  type  of 
^  dubious  activity  (i.e.,  in  an  area  subject  to  extra  scrutiny  due  to  ORT)  to  another  activity  outside  of  the 
tracer  condition.  Some  providers  may  adapt  their  behavior  by  entering  new  (geographic  or  type  of 
service)  areas  thought  to  be  safer  from  government  oversight.  More  broadly  defined  outcome  measures 
are  more  likely  to  be  able  to  capture  such  substitution  patterns,  though  at  the  risk  of  losing  sentinel  effects 
among  the  other  sources  of  variation.  There  is  no  right  answer  among  these  competing  considerations, 
and  our  analyses  include  both  broadly  and  narrowly  defined  outcome  measures. 

The  sentinel  analyses  that  we  performed  estimated  first-order  effects,  but  we  were  not  able  to  pursue  all 
the  different  potential  transformations  of  illicit  activity  that  occur  in  response  to  enforcement  efforts.  For 
that  reason,  estimates  of  "sentinel  effects"  are  not  the  same  as  estimates  of  "savings  from  sentinel 
effects. "  It  is  possible  to  have  enormous  sentinel  effects,  but  minuscule  savings,  simply  because 
wrongdoers  find  new  ways  of  defrauding  the  program.  And  given  the  impossibility  of  measuring  all  the 
different  new  illicit  activities  that  might  be  explored,  it  is  not  possible  to  say  with  certainty  that  a  sentinel 
effect  represents  any  savings  whatsoever.  On  the  other  hand,  if  no  sentinel  effects  are  detected,  even  for 
the  most  narrowly  defined  outcomes,  it  is  difficult  to  claim  that  any  savings  accrued. 

The  sentinel  analyses  focused  on  the  three  major  ORT  focus  areas  (home  health  agencies,  DME  suppliers, 
nursing  homes).  Below,  we  give  a  brief  overview  of  the  analyses  that  were  performed  to  estimate  sentinel 
effects  associated  with  ORT. 

Home  Health  Agencies 

The  key  outcome  measure  used  to  measure  sentinel  effects  in  the  home  health  industry  was  total  home 
health  agency  reimbursement  per  Medicare  enrollee  (at  the  MSA  level).  We  also  analyzed  changes 
associated  with  ORT  in  the  number  (and  percentage)  of  new  and  exiting  agencies. 

Because  free-standing,  for-profit  agencies  are  believed  to  be  more  likely  to  be  involved  in  fraud  and  abuse 
than  hospital-based  or  non-profit  agencies',  we  analyzed  reimbursement  levels  associated  with  ORT 
separately  for  this  type  of  agency. 

Home  health  agencies  with  aberrant  visits  per  beneficiary  have  been  targeted  for  the  Survey  and 
Certification  Reviews  that  were  conducted  in  all  five  ORT  states.  As  a  result.  ORT  may  be  associated  with 
larger  sentinel  effects  for  the  subset  of  agencies  that  had  high  visits  per  beneficiary.  To  measure  sentinel 
effects  for  these  agencies  of  this  type,  we  identified  agencies  that  ranked  in  the  top  15%  in  total  visits  per 


I      This  belief  is  the  result  of  site  visit  discussions  with  HCFA  and  OIG  officials  and  analysis  of  home  health  claims  data,  which  show  a 
positive  correlation  between  home  health  reimbursement  per  beneficiary  and  the  proportion  of  free-standing,  for-profit  agencies 
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beneficiary  (by  state  and  quarter).  Reimbursement  levels  were  then  tracked  over  the  next  year  to  measure 
sentinel  effects  associated  with  ORT. 

Another  hypothesized  sentinel  effect  associated  with  ORT  is  that  the  number  of  new  agencies  may  decline 
and  the  number  of  agencies  that  become  inactive  may  increase.  According  to  economic  theory,  new 
providers  enter  a  market  in  response  to  profit  opportunities,  which  may  be  reduced  by  ORT.  In  addition, 
some  agencies  identified  as  new  entrants  may  be  existing  agencies  that  have  reopened  under  a  new  name 
and  billing  number.  ORT  may  be  associated  with  a  higher  proportion  of  inactive  suppliers  ORT  Survey 
and  Certification  efforts  have  led  to  the  revocation  of  the  billing  numbers  of  some  agencies.  Thus,  ORT 
may  have  had  a  direct  effect  on  the  proportion  of  inactive  agencies.  In  addition,  a  higher  proportion  of 
inactive  suppliers  may  reflect  the  exit  of  agencies  from  markets  that  have  become  unprofitable,  perhaps 
due  to  reduced  opportunities  for  committing  fraud  and  abuse. 

DME  Suppliers 

Allowed  charges  per  Medicare  beneficiary  (at  the  MSA  level)  was  the  key  outcome  measure  used  for 
estimating  sentinel  effects  in  the  DME  industry.  In  addition  to  analyzing  total  DME  expenditures,  we 
separately  analyzed  four  fraud  and  abuse-prone  DME  policy-related  groups  that  were  the  focus  of  specific 
ORT  projects:  incontinence  supplies,  surgical  dressings,  enteral  nutrition,  and  nebulizer  drugs. 

These  four  tracer  measures  were  selected  because  they  were  most  likely  types  of  service  for  which  ORT 
was  associated  with  sentinel  effects.  In  a  major,  high  profile  case,  one  of  the  largest  incontinence  suppliers 
in  the  country  agreed  to  forfeit  more  than  S32  million  after  pleading  guilty  to  conspiracy  to  defraud 
Medicare.  The  Miami  Field  Office  was  active  in  developing  policy  proposals  to  limit  abuse  of  the 
nebulizer  drug  benefit,  at  a  time  when  allowed  charges  per  beneficiary  for  nebulizer  drugs  were  nearly  four 
times  higher  in  Miami  than  in  the  second  highest  MSA.  Enteral  nutrition  and  surgical  dressings  were 
service  areas  with  a  great  deal  of  MSA-level  variation  in  allowed  charges  per  beneficiary,  suggesting  the 
presence  of  fraud  and  abuse.  They  were  also  the  subject  of  several  reports  issued  by  the  Office  of 
Evaluations  and  Inspections  (OEI). 

Skilled  Nursing  Facilities 

Most  ORT  projects  related  to  skilled  nursing  facilities  have  focused  on  Part  B  claims  for  services  provided 
to  nursing  home  residents.  Several  ORT  states  have  specific  projects  designed  to  determine  the  extent  to 
which  Medicare  DME  payments  are  being  made  for  SNF  patients.  In  California,  for  example,  an  Office 
of  Investigations  (01)  case  resulted  in  the  conviction  of  a  nursing  home  owner  for  fraud  involving  billing 
for  DME  supplies  that  had  never  been  purchased  or  given  to  Medicare  beneficiaries.  OAS  in  California 
conducted  audits  of  six  nursing  homes  that  had  a  high  ratio  of  DME  expenditures  to  total  expenditures, 
and  found  evidence  of  overbilling  at  all  six  facilities. 

The  increased  scrutiny  on  medical  supply  costs  for  nursing  home  patients  may  have  resulted  in  reduced 
DME  expenditures  for  nursing  home  patients.  Rather  than  analyze  total  nursing  home  reimbursement,  we 
analyzed  how  ORT  affected  total  allowed  DME  charges  for  patients  with  a  Medicare  covered  nursing 
home  stay  in  the  90  and  180  days  following  date  of  nursing  home  admission.  Note  that  if  ORT  was 
associated  with  reductions  in  the  average  length  of  nursing  home  stays,  then  this  analysis  may 
underestimate  the  impact  of  ORT  or  OME  costs  for  nursing  home  patients. 
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9.1.2    Data  Sources 

HCFA  claims  files  were  the  data  source  for  these  analyses.  The  data  included  information  on  charges  and 
utilization  for  the  years  1 993-96.  Three  analytic  files  were  constructed,  using  claims  data  acquired  through 
the  HCFA  Data  Center. 

1.  Home  health  agency  reimbursement  and  provider  file 

This  file  was  constructed  using  the  100%  Home  Health  Agency  Standard  Analytic  Files  for  1993-96.  The 
file  includes  information  on  Medicare  costs,  beneficiaries,  and  visits  for  Medicare-certified  for-profit, 
hospital-based,  and  non-profit  home  health  agencies.  The  file  was  aggregated  to  the  MSA-level  and 
contains  information  on  more  than  10,000  agencies  that  participated  in  the  Medicare  program  between 
January  1993  and  September  1996.  Because  data  from  the  fourth  quarter  of  1996  were  incomplete,  we 
included  data  from  only  the  first  three  quarters  of  1993-96  in  our  home  health  analyses.  This  restriction 
was  to  insure  that  estimated  sentinel  effects  were  not  biased  by  seasonal  effects  or  the  imputation  of 
incomplete  data  from  the  ORT  period. 

2.  DME  charges  and  utilization  file 

The  5%  sample  Durable  Medical  Equipment  (DME)  100%  Standard  Analytic  Files  for  1993-96  were  used 
to  construct  this  file.  Claims  were  aggregated  to  the  MSA-level.  The  resulting  file  contains  information 
on  the  number  of  users  and  total  allowed  charges  for  all  durable  medical  equipment,  prosthetics,  orthotics, 
and  supplies  (DMEPOS)  procedure  codes  (excluding  vision-related  DME  and  a  few  other  miscellaneous 
codes)  and  for  four  fraud-prone  types  of  DME  which  were  the  focus  of  specific  ORT  initiatives. 

The  specific  types  of  DME  that  we  analyzed  separately  were  (HCPCS  code  range  shown 
parentheses) 

•         Incontinence  appliances  and  supplies  (A4310-A4359;  A5102-A5149) 

DressingsAVound  care  kits  (A4204-A4205;  K0148-K0154;  K0196-K0265) 

Enteral  supplies  and  formulae  (B4034-B4084;  B4150-B4156) 

Nebulizers  and  nebulizer  drugs  (E0570-E0585 ;  J76 1 0-J7699;  KO 1 40-KO 1 46) 

Claims  were  assigned  to  MSAs  based  on  the  residence  of  the  beneficiary  rather  than  the  location  of  the 
supplier,  to  avoid  problems  associated  with  assigning  a  location  to  suppliers  that  have  facilities  in  multiple 
MSAs.  Because  the  DME  data  were  complete  through  the  end  of  1 996,  data  for  all  four  quarters  of  1 993- 
1996  were  included  in  the  analyses. 

3.  DME  for  beneficiaries  with  a  Medicare  covered  nursing  home  admission  file 

The  57c  sample  Skilled  Nursing  Facility  (SNF)  and  the  57c  sample  Durable  Medical  Equipment  (DME) 
100%  Standard  Analytic  Files  were  used  to  construct  this  file.  The  SNF  data  were  used  to  identify  all 
beneficiaries  in  the  5%  sample  who  had  a  Medicare  covered  nursing  home  admission  between  1993  and 
1996.  The  file  includes  information  on  more  than  200,000  admissions. 

DME  charges  for  nursing  home  patients  cannot  be  identified  explicitly  in  Medicare  billing  records, 
because  data  indicating  place  of  service  are  unreliable.  Two  proxy  measures  were  therefore  constructed. 
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based  on  allowed  DME  charges  for  recipients  who  had  been  admitted  to  a  skilled  nursing  facility  (SNF) 
for  an  episode  covered  by  Medicare  within  the  preceding  90  or  180  days.  The  file  was  constructed  using 
the  90  and  1 80  day  windows  rather  than  discharge  dates  because  it  is  not  possible  to  identify  nursing  home 
discharge  date  reliably  using  Medicare  claims  data.  Many  patients  who  appear  to  have  been  discharged 
on  the  basis  of  Medicare  claims  are  actually  still  in  the  nursing  home,  but  no  longer  covered  by  Medicare. 

These  two  measures  are  only  rough  approximations  of  SNF  DME  charges:  the  90-  or  1 80-day  window  may 
be  longer  or  shorter  than  the  actual  nursing  home  stay;  and  many  nursing  home  stays  are  not  covered  by 
Medicare.  Nonetheless,  examination  of  ORT  impacts  on  these  measures  may  give  some  indication  of 
sentinel  effects  on  SNF  DME  charges. 

The  data  were  aggregated  by  MSA  and  year  of  admission.  To  allow  a  six-month  window  for  charges,  we 
therefore  included  in  the  ORT  period  those  SNF  admissions  occurring  between  January  1  and  June  30. 
1 996.  We  then  constructed  three  parallel  time-frames  to  represent  the  pre-ORT  period,  that  included  SNF 
admissions  between  January  1  and  June  30  in  1993,  1994,  and  1995.  For  analysis  of  the  90-day  window, 
each  time-frame  was  extended  an  additional  three  months  to  September  of  the  calendar  year.. 

Some  MSA-years  had  only  a  handful  of  SNF  admissions.  Those  MS  As  that  had  fewer  than  10  countable 
SNF  admissions  in  any  of  the  three  analysis  years  were  combined  with  other  MSAs  in  the  same  State  to 
form  "superMSA's"  of  an  appropriate  size.  The  grouping  was  done  by  sorting  the  MSA-level  data  by 
State  and  by  size,  measured  as  the  minimum  number  of  SNF  admissions  across  the  three  years.  If  the 
smallest  MSA  in  a  State  was  too  small,  it  was  combined  with  successively  larger  ones  until  the  desired  size 
of  10  was  met  or  exceeded.  Sometimes  a  second  superMSA  in  the  same  State  had  to  be  created  as  well. 

9.1.3  Methods 

Our  basic  approach  for  estimating  sentinel  effects  associated  with  ORT  is  to  compare  measures  of  change 
(from  the  pre-ORT  to  the  ORT-period)  for  ORT  states  to  changes  in  a  group  of  comparison  states.  This 
type  of  model  adjusts  for  trends  that  may  have  caused  pre/post  differences  in  ORT  states  even  in  the 
absence  of  the  demonstration.  The  assumption  underlying  this  approach  is  that  any  change  in  the  year-to- 
year  time  trend  that  might  have  occurred  around  the  time  ORT  started  had  the  same  effects  in  both 
demonstration  and  comparison  states. 

Our  assumption  that  sentinel  effects  occurred  only  in  ORT  states  may  lead  to  an  over-  or  underestimate 
of  effects,  if  it  is  incorrect.  Sentinel  effects  may  not  have  been  confined  to  demonstration  states.  Some 
ORT  projects  explicitly  included  non-ORT  states.  In  addition,  providers  in  other  states  were  aware  of 
ORT.  and  their  behavior  may  been  affected  as  a  result.  If  ORT  has  deterred  providers  in  comparison  states 
as  well  as  in  ORT  states,  then  our  models  will  underestimate  actual  sentinel  effects,  since  the  double 
difference  model  will  assume  that  the  resulting  decreases  in  charges  and  utilization  (which  would  be 
observed  across  both  demonstration  and  comparison  states)  are  general  time  trends  rather  than  effects  due 
to  ORT.  Conversely,  if  providers  relocate  to  compiuison  states  in  order  to  avoid  ORT  scrutiny,  then  these 
models  will  tend  to  overstate  sentinel  effects.  The  impact  of  this  type  of  provider  relocation  will  be  to 
make  it  appear  that  costs  have  decreased  in  ORT  states  while  increasing  in  comparison  states,  which  would 
be  counted  as  an  ORT  effect  even  though  such  substitutions  do  not  represent  real  savings  for  the  Medicare 
program. 
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/.  Defining  comparison  states 


Our  estimates  of  ORT  effects  rely  on  comparisons  of  outcomes  observed  in  ORT  states  to  those  observed 
in  some  set  of  comparison  states.  Selection  of  comparison  states  is  complicated  by  the  non-randomized 
nature  of  ORT  and  the  leakage  of  ORT  effects  into  non-ORT  states.  The  ORT  states  were  deliberately 
selected  for  the  likely  impact  of  an  ORT-style  effort.  Other  states  differ  from  the  ORT  states  in  important 
ways  besides  the  presence  of  the  intervention,  making  comparisons  with  other  states  problematic. 

For  most  of  the  analyses  described  in  this  section,  we  compared  outcomes  observed  in  ORT  states  to  those 
observed  in  a  group  of  comparison  states.  Comparison  states  included  all  non-ORT  states  with  an  01 
suhojfice  (Exhibit  9-1 ).  We  are  thus  taking  the  presence  of  a  sub-office  as  a  proxy  for  features  we  wish 
to  hold  common  between  ORT  and  comparison  areas,  such  as  having  a  large,  predominantly  urban 
population,  and  this  rule  excludes  such  states  as  Montana,  Vermont,  Idaho,  Alaska  and  Nebraska.  The 
rule  was  a  simple  way  to  avoid  having  our  subjective  judgement  determine  the  inclusion  or  exclusion  of 
particular  states.  Note  that,  because  of  its  status  as  a  "quasi-ORT"  state,  we  excluded  Louisiana  from  our 
analyses,  since  it  was  subject  to  several  direct,  ORT-style  interventions  from  the  Dallas  Regional  Office. 
This  is  the  same  specification  used  in  our  CIMS  and  AIMS  analyses. 

If  most  of  the  leakage  of  ORT  effects  into  comparison  states  is  confined  to  a  particular  region,  comparison 
of  outcomes  observed  in  comparison  states  in  ORT  regions  compared  to  comparison  states  in  non-ORT 
regions  allows  measurement  of  ORT  effects  that  are  realized  in  the  non-ORT  states  of  a  region.  If 
substitution  of  resources  is  confined  within  the  region,  then  comparison  of  ORT  regions  to  non-ORT 
regions  allows  for  a  measure  of  the  impact  of  ORT  that  is  not  distorted  by  either  diversion  of  resources 
or  leakage  of  ORT  effects  into  neighboring  states.  We  have  carried  out  both  types  of  comparisons. 


Exhibit  9-1:  ORT  Sentinel  Analyses 
Comparison  States 


Alabama 

New  Jersey 

Arizona 

New  Mexico 

Arkansas 

North  Carolina 

Colorado 

Ohio 

Connecticut 

Oklahoma 

Georgia 

Oregon 

Indiana 

Pennsylvania 

Iowa 

Rhode  Island 

Kentucky 

South  Carolina 

Maryland 

Tennessee 

Massachusetts 

Utah 

Michigan 

Virginia 

Minnesota 

Washington 

Missouri 

Wisconsin 

2.  Estimation  techniques 


A  double  difference  approach  was  used  to  estimate  the  sentinel  effects  of  ORT.  In  essence,  the  deviation 
of  the  outcome  in  the  ORT  States  during  the  ORT  period  from  what  would  have  been  predicted,  based 
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on  pre-ORT  experience,  was  compared  to  the  corresponding  deviation  in  the  non-ORT  comparison  States. 
In  simplest  terms,  the  double  difference  model  can  be  written  as: 

Y„  =  bo  +  b|  ORT„  +  b,  ORTSTATE,  +  b,  ORTYEAR, , 

where   Y|,  is  the  outcome  measure  of  interest  for  MSA  /  in  year  r, 

ORT„  is  an  indicator  that  MSA  /'  was  in  a  State  that  was  experiencing  ORT  in  year  t, 
ORTSTATE ,  is  an  indicator  that  MSA  /  was  in  an  ORT  State,  and 
ORTYEAR,  is  an  indicator  that  year  t  was  an  ORT  year,  i.e.  1996  in  our  data. 

The  coefficient  b,  represents  the  estimated  impact  of  ORT,  that  is,  the  difference  between  the  actual 
outcome  in  an  MSA  that  was  experiencing  ORT.  and  what  would  have  been  predicted  for  that  MSA.  given 
(a)  that  it  was  in  an  ORT  State  (which  may  have  tended  to  have  higher  values  of  the  outcome  measure 
even  in  the  pre-ORT  period),  and  (b)  that  the  year  was  1996  (which  may  have  been  unusual  in  terms  of 
the  outcome  measure  even  in  non-ORT  comparison  States). 

This  simple  model  was  modified  in  several  ways.  It  seemed  likely  that  much  of  the  variation  in  the 
outcomes  was  due  to  underlying  differences  among  the  MSAs  that  comprised  the  sample.  Furthermore, 
demonstration  states  may  have  been  selected,  in  part,  because  they  had  experienced  not  only  higher  levels 
but  also  higher  growth  rates  of  both  home  health  and  DME  costs.  To  account  for  the  first  of  these  factors, 
a  fixed  effects  term  was  added  for  each  MSA.  Each  MSA  thus  had  its  own  intercept,  differences  among 
which  captured  general  differences  among  the  MSAs  in  the  pre-ORT  period.  These  separate  intercepts 
rendered  the  overall  intercept  and  the  ORTSTATE  indicator  moot,  so  those  terms  were  dropped.  To 
address  the  issue  of  growth,  it  was  assumed  that  the  outcome  followed  a  time  trend  over  the  pre-ORT 
period  that,  absent  ORT,  would  have  continued  through  1996.  This  time  trend  was  potentially  different 
in  the  ORT  States  than  in  the  comparison  States. 

Incorporating  these  considerations  led  to  our  basic  model  for  estimating  the  sentinel  effects  of  ORT: 

Yi,  =  [Fixed  effects]  +  b,  ORT,,  +  b,  (YEAR,  -  1992) 

+  b,  (YEAR,  -  1992  )x  ORTSTATE,  +  b^  ORTYEAR,. 

The  fixed  effects,  which  were  not  of  interest  in  themselves,  were  estimated  implicitly.  As  before,  b, 
represents  the  ORT  sentinel  effect.  The  other  terms  in  the  equation  represent  the  linear  time  trend  for  all 
States,  the  differential  linear  time  trend  for  ORT  States,  and  any  general  (non-ORT)  effects  associated  with 
the  year  1996. 

Also  of  interest  were  the  individual  ORT  effects  by  State.  To  estimate  these,  the  ORT  indicator  was 
replaced  by  a  set  of  five  variables  indicating  that  the  observation  represented  an  MSA  specifically  in 
California,  Florida,  Illinois,  New  York,  or  Texas  in  the  ORT  period.  At  the  same  time,  the  ORTSTATE 
indicator  was  replaced  by  a  set  of  five  variables  corresponding  to  the  individual  ORT  States,  to  allow  for 
variations  in  pre-ORT  time-trends  among  these  States. 

A  final  pair  of  models  explored  the  potential  spillover  or  diversion  effects  of  ORT  with  respect  to 
neighboring  States.  ORT  effects  were  now  sought  in  non-ORT  States  within  regions  that  contained  an 
ORT  State,  contrasted  with  the  other  comparison  States.  The  five  ORT  States  themselves  were  excluded 
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from  this  subanalysis.  A  reduction  in  costs  in  the  ORT  regions  would  indicate  a  favorable  spillover;  higher 
costs  in  these  regions  would  suggest  that  resources  had  been  diverted  to  the  ORT  state,  at  the  expense  of 
controlling  Medicare  reimbursements  in  the  non-ORT  States  in  the  same  regions. 

The  unit  of  observation  was  in  general  the  MSA-year Non-MSA  areas  were  aggregated  together  to  form 
a  single  non-MSA  observation  for  each  State.  The  residuals  in  the  equations  are  heteroskedastic — that 
is,  because  the  dependent  variable  is  a  mean  or  proportion  based  on  varying  number  of  cases,  it  is 
measured  with  more  accuracy  in  larger  MSAs  than  in  smaller  ones,  leading  to  greater  or  lesser  variance 
of  the  residual.  To  account  for  this  feature,  observations  in  the  regression  equation  models  were  weighted 
by  the  number  of  observations  comprising  the  mean  (i.e.,  the  number  of  Medicare  enrollees  or  the  number 
of  nursing  home  admissions,  depending  on  the  outcome  measure  being  analyzed). 

An  implicit  assumption  in  the  model  is  that  no  ORT  sentinel  effects  occurred  until  1996.  While  ORT 
officially  started  in  April  1995,  implementation  of  many  ORT  projects  did  not  occur  for  several  months. 
More  importantly,  it  took  time  for  word  of  ORT  to  spread  to  the  provider  community,  and  provider 
behavior  could  not  be  affected  until  they  learned  about  the  potential  consequences  of  ORT  on  their 
operations.  It  seemed  more  reasonable  to  treat  1995  as  a  pre-ORT  year  (and  use  it  to  help  estimate  the 
pre-ORT  time  trend)  than  to  look  for  ORT  effects  in  that  year. 

9.2    Home  Health  Care 

Medicare's  home  health  benefit  allows  beneficiaries  with  restricted  mobility  to  receive  care  at  home,  thus 
avoiding  institutionalization.  The  home  health  benefit  has  grown  rapidly  in  recent  years,  from  about  $3.3 
billion  in  1990  to  nearly  $16  billion  in  1996.  Part  of  this  increase  is  believed  to  be  due  to  higher  levels 
of  fraud  and  abuse.  Home  health  care  is  especially  vulnerable  to  fraud  and  abuse  because  Medicare  covers 
an  unlimited  number  of  visits  per  patient,  beneficiaries  pay  no  co-payments  and  receive  no  explanation 
of  benefits  for  bills  submitted  by  home  health  agencies,  and  there  is  limited  direct  medical  supervision  of 
health  services  provided  by  non-medical  personnel. 

The  ORT  partners  were  involved  in  a  number  of  projects  designed  to  combat  fraud  in  the  home  health 
industry.  During  ORT,  OAS  opened  41  audits  of  home  health  agencies,  compared  to  only  13  between 
1 990  and  1 994.  ORT  was  associated  with  a  1 55%  increase  in  the  number  of  criminal  cases  against  HHAs. 
HCFA,  OAS,  and  state  certification  agencies  collaborated  on  reviews  of  home  health  agencies  that  were 
conducted  to  review  a  variety  of  coverage  issues,  including  homebound  status,  inappropriate  or  excessive 
services,  and  services  ordered  by  a  physician  who  does  not  appear  to  be  treating  the  patient. 

9.2.1     General  Trends 

Reimbwsement  levels  (per  Medicare  enrollee) 

Nationwide,  home  health  expenditures  increased  steadily  from  1993-95,  but  grew  at  a  much  smaller  rate 
in  1 996  (Exhibit  9-2).  Reimbursement  (per  Medicare  enrollee)  increased  by  45%  between  1 993  and  1 995, 
but  by  only  3%  in  1996. 


For  DME  and  home  health  claims,  year  is  based  on  the  year  thai  the  claim  was  submitted  For  the  DME  for  nursing  home  patients  file, 
year  was  assigned  based  on  the  year  of  admission. 
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Exhibit  9-2.  ORT  Sentinel  Analyses: 
HHA  Allowed  Charges  per  Medicare  Enrollee  (All  Agencies) 

$800  ,  .  


1993  1994  1995  1996 

Year 

Note:  This  chart  is  based  on  data  for  HHA  allowed  charges  during  the  first  9  months  of  each  calendar  yi 
Source:  HCFA  Home  Health  Agency  100%  Standard  Analytic  File. 
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In  California,  Florida,  and  Illinois,  the  level  of  reimbursement  per  Medicare  enrollee  was  lower  in  1 996 
than  in  1995.  The  rate  of  growth  in  New  York  was  lower  than  for  comparison  states  as  a  group.  With 
respect  to  both  the  level  and  growth  rate  of  costs  for  home  health,  Texas  is  unlike  any  ORT  state  and 
almost  all  of  the  comparison  states.  Between  1993  and  1995,  only  Oklahoma  had  a  growth  rate  as  high 
as  that  observed  in  Texas,  and,  by  1995,  only  Tennessee  had  a  level  of  reimbursement  as  high  as  that  of 
Texas.  In  Texas,  reimbursement  increased  by  73%  between  1993  and  1995,  and  by  18%  in  1996,  the 
fastest  growth  rate  in  the  country. 

Proportion  of  New  and  Inactive  Agencies 

Some  ORT  projects  were  intended  to  decertify  agencies  that  did  not  meet  Medicare  guidelines,  leading 
to  a  direct  impact  of  ORT  on  the  number  of  inactive  agencies.  If,  in  addition,  ORT  resulted  in  sentinel 
effects,  then  we  would  expect  the  demonstration  to  be  associated  with  additional  increases  in  the 
proportion  of  inactive  agencies  and  decreases  in  the  proportion  of  new  agencies. 

In  comparison  states  and  four  of  the  five  ORT  states,  the  proportion  of  inactive  agencies  increased  in  1996 
(Exhibit  9-3).  In  Florida,  the  proportion  of  inactive  agencies  grew  from  1.7%  to  2.6%  between  1993  and 
1995,  but  increased  to  5.5%  in  1996.  The  proportion  of  inactive  agencies  in  Texas  and  California  nearly 
doubled  between  1995  and  1996.  Illinois  was  the  only  ORT  state  where  the  proportion  of  inactive 
suppliers  decreased  between  1995  and  1996. 


Exhibit  9-3:  ORT  Sentinel  Analyses 

Home  Health  Agency  Percentage  of  New  and  Inactive  Agencies: 
Descriptive  Statistics  for  ORT  and  Comparison  States 


Percentage  of  new  agencies 


State 

1993 

1994 

1995 

1996 

1993 

1994 

1995 

1996 

California 

29.6% 

18.0% 

1 9.5% 

13.0% 

7.9% 

2.9% 

4.3% 

8.2% 

Florida 

7.9% 

3.8% 

9.1% 

8.8% 

2.2% 

1 .7% 

2.6% 

5.5% 

Illinois 

1 1 .0% 

10.8% 

7.8% 

3.5% 

3.7% 

3.0% 

3.0% 

2.1% 

New  York 

13.5% 

4.4% 

4.3% 

4.7% 

4.7% 

1 .0% 

3.3% 

3.8% 

Texas 

31.2% 

27.7% 

24.4% 

21.1% 

4.0% 

4.4% 

3.0% 

5.9% 

Comparison  states 

13.6% 

10.5% 

9.4% 

7.0% 

4.3% 

3.2% 

3.0% 

4.2% 

Percentage  of  inactive  agencies 


Notes:     A.  New  agencies  were  defined  as  those  who  had  zero  reimbursement  in  the  previous  quarter.  Inactive 
agencies  were  those  who  had  zero  reimbursement  in  a  quarter,  but  positive  reimbursement  in  the 
previous  quarter.  Because  it  was  not  possible  to  identify  agencies  that  were  new  in  the  first  quarter  of 
1993,  the  fourth  quarter  of  1993  was  used  to  impute  the  number  of  new  agencies  from  the  first  quarter  of 
the  year. 

B     Data  based  on  the  first  three  calendar  quarters  of  each  year  only 
Sources:  HCFA  Home  Health  Agency  100%  Standard  Analytic  File 
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It  is  not  possible  for  us  to  determine  how  much  of  this  decrease  is  due  to  decertification  actions  taicen  as 
a  result  of  ORT  and  how  much  are  due  to  other  reasons,  but  both  California  and  Texas  used  compliance 
surveys  to  eliminate  sub-standard  agencies  from  the  Medicare  program.  In  California,  the  purpose  of  the 
surveys  was  to  establish  compliance  with  all  the  conditions  for  conditions  for  participation  for  home  health 
agencies,  and  the  surveys  could  provide  grounds  for  instituting  provider  termination  procedures. 

The  percentage  of  new  agencies  opened  in  1996  (relative  to  1995)  declined  across  comparison  states  and 
in  four  of  the  five  ORT  states  (Exhibit  9-3).  California  and  Illinois  had  the  largest  decreases  in  the 
percentage  of  new  agencies,  and  there  were  smaller  decreases  in  Texas  and  Florida.  In  New  York,  where 
there  was  a  slight  increase  in  new  entrants  between  1995  and  1996,  the  proportion  of  new  agencies  in  1996 
(5%)  was  still  much  lower  than  in  1993  (14%). 

Visits  Per  Beneficiary 

Across  comparison  states,  total  visits  per  beneficiary  (defined  based  on  the  total  number  of  visits  in  a 
quarter  divided  by  the  number  of  home  health  beneficiaries  in  that  quarter)  increased  by  11%  between 
1993  and  1995,  but  stayed  relatively  constant  between  1995  and  1996  (Exhibit  9-4).  Three  of  the  ORT 
states  had  declines  in  visits  per  beneficiary  during  1996,  with  the  largest  decreases  occurring  in  Texas  and 
Florida.  In  Texas,  which  had  higher  visits  per  beneficiary  than  any  state  other  than  Oklahoma,  visits  per 
beneficiary  increased  by  almost  10%  between  1995  and  1996. 


Exhibit  9-4:  ORT  Sentinel  Analyses 

Home  Health  Agency  Visits  per  Beneficiary: 

Descriptive  Statistics  for  ORT  and  Comparison  States 


State 

1993 

1994 

1995 

1996 

California 

22.26 

24.76 

27.64 

27.12 

Florida 

35.50 

37.75 

39.94 

39.25 

Illinois 

21.51 

24.11 

25.54 

25.42 

New  York 

24.92 

26.21 

28.58 

28.87 

Texas 

35.31 

41.84 

48.34 

53.00 

Comparison  states 

27.60 

29.91 

31.75 

31.99 

Note:       A.  Total  visits  per  beneficiary  defined  as  total  visits  in  quarter 
divided  by  total  HHA  beneficiaries  in  quarter. 


B     Data  based  on  the  first  three  calendar  quarters  of  each  year 
only 

Sources:  HCFA  Home  Health  Agency  100%  Standard  Analytic  File 


9.2.2    Estimated  Impacts  of  ORT 

The  key  outcome  measures  that  we  analyzed  included  total  Medicare  home  health  reimbursement  (per 
Medicare  enrollee)  and  total  visits  per  beneficiary  (i.e.,  home  health  user).  As  discussed  in  Section  9. 1 .3, 
all  models  included  fixed  effects  for  each  MSA,  a  general  time  trend,  a  differential  time  trend  for  MSAs 
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in  ORT  states,  an  ORT  period  (1996)  indicator,  and  an  ORT  indicator  (indicating  that  the  observation  was 
from  an  ORT  state  and  the  ORT  period). 

For  each  set  of  models,  we  estimated  the  impact  of  ORT  on  home  health  reimbursement  for  all  home 
health  agencies,  and  separately  for  free-standing,  for  profit  agencies,  and  "high  visit  per  beneficiary" 
agencies,  defined  as  those  in  the  85th  percentile  (by  state  and  quarter)  in  visits  per  beneficiary.  In  addition, 
we  estimated  the  impacts  associated  with  ORT  proportion  of  new  and  inactive  suppliers,  and  on  visits  per 
beneficiary  across  ail  agencies.  First,  we  discuss  results  from  models  that  included  a  single  ORT  indicator 
for  the  five  ORT  states  as  a  group.  This  is  followed  by  a  presentation  of  regression  models  that 
incorporated  separate  indicators  and  pre-ORT  time  trends  for  each  ORT  state. 


Overall  ORT  Effects:  Home  Health  Reimbursement 


For  the  five  ORT  states  as  a  group,  the  impact  of  ORT  on  overall  HHA  reimbursement  per  Medicare 
enroUee  (-$4)  was  not  statistically  significant  (Exhibit  9-5).  In  the  pre-ORT  period,  reimbursement 
increased  by  about  $48  per  year  in  comparison  states,  and  by  about  $61  per  year  in  ORT  states  (the  sum 
of  the  overall  time  trend  ($48.32)  and  the  differential  time  trend  in  ORT  states  ($13)).  In  1996, 
reimbursement  levels  in  comparison  states  were  about  $40.00  less  than  the  level  implied  by  the  1993-95 
time  trend,  and  about  $44.00  less  in  ORT  states  (the  sum  of  the  ORT  year  and  ORT  impact  coefficients). 


Exhibit  9-5:  ORT  Sentinel  Analyses 

Regression  Models  for  the  Home  Health  Industry:  Reimbursement  per  Medicare 
Enrollee 


Reimbursement  per  Medicare  enrollee  for 

Free-standing,  for-         High  visit  per 
Variable  AH  agencies  profit  agencies       beneficiary  agencies 


ORT  impact  (across  all  -3.76  -3.06  -3.89 

five  ORT  states)  (12.58)  (11.65)  (13.29) 


Time  trend  (Year)                     48.32"*  19.04***  15.54*** 

(3.21)  (3.00)  (3.51) 

ORT  year  (1996)                      -39.56***  -14.49*  -16.80* 

(8.20)  (7.65)  (8.82) 

Differential  time  trend  in              12.58**  16.82***  10.05* 

ORT  states  (in  pre-ORT  (4.92)  (4.56)  (5.29) 
period) 


Mean  of  dependent  $269.22  $107.63  $67.22 

vanable 


Sources:  HCFA  Home  Health  100%  Standard  Analytic  File 

Note:  Models  based  on  first  three  calendar  quarters  of  each  year  only. 

Standard  errors  shown  in  parentheses 


Statistically  significant  at  level 
Statistically  significant  at  5%  level 
Statistically  significant  at  10%  level 
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ORT  also  had  a  small,  insignificant  impact  on  reimbursement  (-S3)  for  free-standing,  for-profit  agencies. 
In  1996,  reimbursement  levels  for  these  agencies  were  $14  less  in  comparison  states  than  implied  by  the 
1993-95  time  trend,  and  SI 8  less  in  ORT  states.  Across  all  ORT  states,  the  impact  of  ORT  on 
reimbursement  levels  for  high-visit-per-beneficiary  agencies  was  also  negative,  but  statistically 
insignificant. 

For  the  subset  of  agencies  that  were  in  the  top  15%  in  visits  per  beneficiary  in  1994  or  1995,  ORT  was 
also  associated  with  a  negative  but  statistically  insignificant  impact  on  reimbursement  per  beneficiary  (- 
S4).  In  1996,  reimbursement  for  these  agencies  was  $17  less  than  suggested  by  the  1993-95  time  trend 
in  comparison  states,  and  almost  $21  less  in  ORT  states. 

In  comparison  states,  reimbursement  per  enrollee  was  significantly  lower  than  the  level  implied  by  the 
1993-95  time  trend,  as  shown  by  the  ORT  year  coefficient.  This  may  be  in  part  a  reflection  of  spillover 
effects  of  ORT  into  comparison  states.  Home  health  agencies  across  the  nation  learned  of  ORT  through 
industry  newsletters,  conferences,  and  word-or-mouth,  and  agencies  in  non-ORT  states  may  have  been 
concerned  about  the  implications  of  ORT  on  their  business.  There  were  efforts  other  than  ORT  to  try  to 
limit  growth  of  the  home  health  benefit,  so  it  is  not  possible  to  detennine  what  proportion  of  the  general 
negative  time  trend  observed  in  1996  was  due  to  ORT  spillover  effects. 

Overall  ORT  Effects:  Visits  Per  Beneficiary 

Across  the  five  demonstration  states,  ORT  was  associated  with  a  very  small  and  statistically  insignificant 
change  in  the  level  of  visits  per  HHA  beneficiary  (Exhibit  9-6).  Across  ORT  and  comparison  states,  visits 
per  beneficiary  in  1996  were  about  9%  less  than  the  level  implied  by  the  1993-95  time  trend.  The  effects 
of  ORT  on  visits  per  beneficiary  for  free-standing,  for-profit  agencies  were  similar  to  those  for  all  agencies. 

For  the  subset  of  agencies  with  high  visits  per  beneficiary,  however,  a  larger  impact  was  found:  a  decrease 
of  4.8  visits  per  beneficiary,  statistically  significant  at  the  10%  level.  Nationwide,  in  1996,  visits  per 
beneficiary  for  the  subset  of  high-cost  agencies  were  about  10%  less  than  in  the  pre-ORT  period. 
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Exhibit  9-6:  ORT  Sentinel  Analyses 

Regression  Models  for  the  Home  Health  Industry:  Visits  per  Beneficiary  

Visits  per  beneficiary  for: 
All  agencies     Free-standing      High  visit  per 


Variable 

for-profit 

anencies 

beneficiary 

H      ^  1  IWIWW 

ORT  impact  (across  all  five 

-0.39 

-0.26 

-4.84* 

ORT  states) 

(0.73) 

(0.87) 

(2.66) 

Time  trend  (Year) 

1.99*" 

2.60*** 

5.63*** 

(0.13) 

(0.23) 

(0.70) 

ORT  year  (1996) 

-1.91*" 

-2.17*" 

-5.30*** 

(0.48) 

(0.58) 

(1.76) 

Differential  time  trend  in  ORT 

0.77*** 

0.74" 

(2.99** 

states  (in  pre-ORT  period) 

(0.19) 

(0.34) 

(1.06) 

Mean  of  Dependent  Variable 

29.74 

37.84 

55.77 

Sources:  HCFA  Home  Health  100%  Standard  Analytic  File 

Note:  Models  based  on  first  three  calendar  quarters  of  each  year  only. 
Standard  errors  shown  in  parentheses 


Statistically  significant  at  1  %  level 
Statistically  significant  at  5%  level 
Statistically  significant  at  10%  level 


State-specific  ORT  Effects:  Home  Health  Reimbursement 

Across  all  home  health  agencies,  ORT  had  a  negative,  but  relatively  insignificant,  impact  on  home  health 
reimbursement  levels  for  each  of  the  five  ORT  states  (Exhibit  9-7).  In  California,  Florida,  and  Texas, 
ORT  was  also  associated  with  negative,  but  insignificant,  changes  in  reimbursement  levels  for  the  subsets 
of  free-standing,  for-profit  agencies  and  for  agencies  with  high  visits  per  beneficiary. 

State-specific  ORT  Effects:  Visits  Per  Beneficiary 

While  ORT  was  associated  with  a  reduction  in  total  visits  per  beneficiary  for  every  demonstration  state 
except  for  New  York,  the  coefficients  were  small  and  not  statistically  significant  (Exhibit  9-8).  Results 
for  the  subset  of  free-standing,  for-profit  agencies  were  similar  to  those  for  all  agencies.  In  California, 
however,  ORT  was  associated  with  a  large,  statistically  significant  reduction  in  visits  per  beneficiary  for 
high-visit  agencies.  In  California,  visits  per  beneficiary  for  these  agencies  were  about  20%  less  than  they 
would  have  been  in  the  absence  of  ORT. 
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Exhibit  9-7:  ORT  Sentinel  Analyses 

Regression  Models  for  the  Home  Health  Industry:  Reimbursement  per  Medicare 
Enrollee 

Reimbursement  per  Medicare  enrollee  for 


All  agencies       Free-standing,  for-         High  visit  per 
Variable  profit  agencies      beneficiary  agencies 


ORT  impact  for: 

lif  rvrnia 

-ft  7Q 

-9  fin 

(15.66) 

(13.55) 

(17.79) 

-13  4fi 

-23  17 

(17.98) 

(15.74) 

(18.54) 

lllinni«5 

-12.27 

-6  72 

14  08 

(20.95) 

(17.97) 

(20.42) 

Mpw  York 

-21  fi'? 

12.38 

17  22 

(15.93) 

(13.73) 

(16.30) 

-28  07 

(20.05) 

(17.21) 

(18.52) 

TSmo  tr^nH  /Y^fir^ 

1  II 1  i«7  11  CI  lU  ^  1  Cal  1 

48.31*** 

19.04 

15.54*** 

(2.48) 

(2.18) 

(2.66) 

ORT  MMr  MQQR^ 

-14.49 

-16.80** 

(6.34) 

(5.55) 

(6.69) 

LyillciciHlcti  lllilt;  iiciiu 

in  ORT  states: 

California 

-4.92 

4.26 

-2.60 

(6.14) 

(5.31) 

(7.19) 

Florida 

9.31 

11.44* 

-0.93 

(7.05) 

(6.17) 

(7.28) 

Illinois 

1.67 

2.75 

-13.08 

(8.17) 

(7.03) 

(8.41) 

New  York 

-21.87*** 

-15.88*** 

-15.30** 

(6.21) 

(5.36) 

(6.37) 

Texas 

117.64*** 

115.90*** 

86.77*** 

(7.87) 

(6.78) 

(7.34) 

Mean  of  dependent 
variable 

$269.22 

$107.63 

$67.22 

Sources:  HCFA  Home  Health  Agency  100%  Standard  Analytic  File 

Standard  errors  shown  in  parentheses 

*•" :    Statistically  significant  at  1%  level 
"  :    Statistically  significant  at  5%  level 
Statistically  significant  at  10%  level 
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Exhibit  9-8:  ORT  Sentinel  Analyses 

Regression  Models  for  the  Home  Health  Industry:  Visits  per  Beneficiary 


Variable 


Visits  per  beneficiary  for: 


All  agencies 


Free-standing  for- 
profit  agencies 


High  visit  per 
beneficiary  agencies 


ORT  impact  for: 

California 

Florida 
Illinois 
New  York 
Texas 


-1.21 
(0.91) 

-0.99 
(1.04) 

-0.55 
(1.22) 

0.73 
(0.93) 

-0.11 
(1.16) 


-1.30 
(1.31) 

-1.23 
(1.52) 

-1.77 
(1.73) 

2.09 
(1.32) 

-0.09 
(1.66) 


-12.53** 
(4.44) 

-7.16 
(4.62) 

1.75 
(5.10) 

-4.29 
(4.07) 

0.79 
(4.62) 


Time  trend  (Year)                2.00***  2.60***  5.62*** 

(0.09)  (0.21)  (0.62) 

ORT  year  (1996)                 -1.91***  -2.17***  -5.31** 

(0.37)  (0.54)  (1.67) 

Differential  time  trend  in  ORT  states: 

California                          0.54**  0.70  5.60*** 

(0.24)  (0.51)  (1.79) 

Florida                             0.18  0.45  -1.14*** 

(0.28)  (0.60)  (1.82) 

Illinois                              0.11  0.30  -2.28 

(0.33)  (0.68)  (2.10) 

New  York                         -0.42*  -0.98*  7.20*** 

(0.25)  (0.52)  (1.59) 

Texas                               4.53***  4.56***  2.32 

(0.31)  (0.65)  (1.83) 

Mean  dependent                  29.74  37.84  55.77 
variable 

Sources:  HCFA  Home  Health  100%  Standard  Analytic  File 

Note:  Models  based  on  first  three  calendar  quarters  of  each  year  only.  Standard  errors  shown  in  parentheses 
"• :    Statistically  significant  at  1  %  level 
■"  :    Statistically  significant  at  5%  level 

:    Statistically  significant  at  10%  level   
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9.3    Durable  Medical  Equipment  (DME) 


Allowed  charges  for  DME  supplies  increased  steadily  between  1992  and  1995,  and  there  were  especially  large 
increases  in  allowed  charges  for  selected  types  of  DME  and  in  Florida.  Anecdotal  evidence  suggests  that  the 
level  of  OME  fraud  and  abuse  may  have  surged  in  recent  years.  An  informal  study  conducted  in  1993  by  the 
State  of  Florida's  Medicaid  program  estimated  that  75%  of  the  new  provider  applicants  in  the  state  were  not 
capable  of  delivering  professional  health  care  services,  and,  in  all  probability,  were  intent  on  committing  fraud 
if  given  a  supplier  number.  On-site  reviews  of  a  sample  of  new  Florida  supplier  applications  received  in 
March  1 996  found  that  89%  were  not  operational  entities,  as  they  did  not  have  a  physical  location. 

Our  primary  outcome  measure  was  total  DME  allowed  charges  per  Medicare  enrollee.  We  also  investigated 
four  specific  types  of  DME  that  were  fraud-prone  areas  that  were  the  focus  of  specific  ORT  projects: 
incontinence  supplies,  surgical  dressings,  enteral  nutrition,  and  nebulizer  drugs.  These  four  categories 
constituted  a  relatively  small  fraction  of  total  DME  allowed  charges;  in  1995  for  example,  they  amounted  to 
about  $31  per  Medicare  enrollee:  only  about  17%  of  total  DME  charges  for  that  year. 

9.3.1     General  Trends 

Exhibit  9-9  summarizes  the  nationwide  trends  in  total  DME  charges  over  the  period  1993  to  1996  for  the  five 
ORT  states  and  the  average  across  comparison  states.  Total  DME  charges  rose  by  almost  S40  per  Medicare 
enrollee  over  period,  from  $154  to  $192\  The  fastest  rate  of  increase  occurred  between  1994  and  1995. 
Between  1995  and  1996,  allowed  charges  grew  more  slowly,  perhaps  reflecting  the  greater  awareness  of  fraud 
and  abuse  of  the  DME  benefit  and  the  efforts  of  the  DMERCs  and  the  National  Supplier  Clearinghouse  to 
control  benefits. 


Exhibit  9-9:  ORT  Sentinel  Analyses 

DME  Annual  Charges  Per  Medicare  Enrollee:  Nationwide  Descriptive  Statistics,  1993  - 1996 


Allowed  Charges  Per  Medicare  Enrollee 


Category 

1993 

1994 

%  change 

1995 

%  change 

1996 

%  change 

Total  DME 

$154.25 

$167.16 

8.4 

$185.90 

11.2 

192.24 

3.4 

Incontinence  Supplies 

6.78 

6.75 

0.00 

3.67 

-45.6 

1.94 

-47.1 

Surgical  Dressings 

1.49 

1.81 

21.5 

3.05 

68.5 

1.48 

-51.5 

Enteral  Nutrition 

17.91 

16.73 

-6.6 

14.38 

-14.0 

13.52 

-6.0 

Nebulizer  Drugs 

7.07 

6.82 

-3.5 

9.77 

43.4 

9.94 

1.6 

Sources:  HCFA  5%  Sample  for  the  100%  Durable  Medical  Equipment  Standard  Analytic  File 

Our  1996  estimates  may  turn  out  to  be  slightly  low  since  not  all  1996  charges  may  have  been  processed  by  the  time  we  drew  our  data 
sample.  Comparison  with  other  quarters,  however,  suggested  that  the  underestimate  is  probably  fairly  small. 
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Costs  increased  throughout  the  period  for  comparison  states  and  for  three  of  the  ORT  states  (Texas, 
California,  and  Ilhnois)  (Exhibit  9-10).  In  Florida,  by  contrast,  allowed  charges  rose  steadily  between 

1993  and  1995,  but  declined  during  1996.  Note  that  the  level  of  allowed  charges  was  much  higher  in 
Florida  than  for  any  other  ORT  state.  In  New  York,  which  had  the  lowest  allowed  charges  per  enrollee 
among  the  demonstration  states,  allowed  charges  also  declined  slightly  between  1995  and  1996. 

By  contrast,  the  four  selected  DME  sub-groups  did  not  show  such  constant  cost  increases.  In  fact, 
between  1993  and  1996  costs  per  Medicare  enrollee  decreased  for  incontinence  supplies.  This  decrease 
was  due  in  part  to  a  large  decrease  in  costs  in  Texas  (Exhibit  9-11).  although  allowed  charges  declined  in 
both  1995  and  1996  in  every  ORT  state.  Incontinence  supplies  came  under  increasing  scrutiny  after  the 
issuing  of  an  OEI  study  that  reported  a  dramatic  increase  in  incontinence  supplies  to  nursing  facilities 
nationwide.  These  efforts  continued  during  ORT,  with  several  criminal  ca.ses  opened  against  distributors 
of  incontinence  supplies.  During  ORT,  one  of  the  country's  largest  suppliers  of  incontinent  care  products 
in  the  U.S.  agreed  to  forfeit  $32  million  seized  in  bank  accounts. 

Allowed  charges  for  enteral  nutrition  decreased  substantially  over  the  period.  This  decrease  was  due  in 
large  part  to  extraordinary  decreases  from  extraordinary  initial  levels  of  cost  in  Florida,  especially  South 
Florida.  From  1993  to  1994,  allowed  charges  per  beneficiary  in  Florida  decreased  from  $52  to  S49,  while 
the  much  lower  allowed  charges  per  beneficiary  nationwide  decreased  slightly  (from  S 1 8  to  S 1 7  over  this 
period)  (Exhibit  9-12).  By  1996,  allowed  charges  per  beneficiary  in  Florida  decreased  to  $12,  a  drop  of 
over  75%  to  a  level  below  the  1996  national  average  of  almost  $14. 

Allowed  charges  for  surgical  dressings  increased  by  687f  between  1994  and  1995,  but  fell  by  more  than 
507c  between  1995  and  1996,  to  approximately  the  1993  level.  Among  ORT  states,  allowed  charges  for 
surgical  dressings  nearly  doubled  between  1994  and  1995  in  Florida,  before  declining  sharply  in  1996 
(Exhibit  9-13).  For  other  ORT  states,  there  was  a  smaller  increase  in  1995  and  a  decrease  in  1996.  In 

1994  and  1995,  the  DMERCs  identified  surgical  dressings  as  a  fraud  and  abuse-prone  type  of  service,  and 
initiated  a  number  of  efforts  to  control  the  benefit,  especially  for  nursing  home  residents.  The  1996 
reduction  in  allowed  charges  for  surgical  dressings  probably  reflects  a  combination  of  efforts  by  the 
DMERCs  and  by  the  ORT  partners. 

Allowed  charges  for  nebulizer  drugs  fell  between  1993  and  1994.  but  rose  by  43%  between  1994  and 
1995.  This  increase  was  due  in  large  part  to  aberrant  nebulizer  drug  charges  in  Florida  (Exhibit  9-14). 
In  1 994,  allowed  charges  per  enrollee  for  nebulizer  drugs  were  200%  higher  in  Flonda  than  in  comparison 
states,  due  primarily  to  Miami,  where  allowed  charges  were  $145  per  beneficiary,  compared  to  $8 
nationwide.  Between  1995  and  1996,  however,  allowed  charges  for  nebulizer  drugs  increased  by  only 
1 .6%.  and  they  declined  sharply  in  Florida,  though  Florida  remained  well  above  the  other  ORT  and  non- 
ORT  states. 
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Exhibit  9-10.  ORT  Sentinel  Analyses: 
Total  Allowed  DME  Charges  per  Medicare  Enrolee 


1993 


1994  1995 

Year 


1996 


California 


Florida 


linois 


New  York 


Texas 


Comparison  States 


Source:  HCFA  5%  Sample  of  the  100%  Durable  Medical  Equipment  (DME)  Standard  Analytic  File. 
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Exhibit  9-11.  ORT  Sentinel  Analyses: 
Allowed  Charges  per  Medicare  Enrolee  for  Incontinence  Supplies 


$0  ' 

1993  1994  1995  1996 

Year 


Source:  HCFA  5%  Sample  of  the  100%  Durable  Medical  Equipment  (DME)  Standard  Analytic  File. 
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Exhibit  9-12.  ORT  Sentinel  Analyses: 
Allowed  Charges  per  Medicare  Enrollee  for  Enteral  Nutrition 

$60  I  , 


$0  I  

1993  1994  1995  1996 

Year 


Source;  HCFA  5%  Sample  of  the  100%  Durable  Medical  Equipment  (DME)  Standard  Analytic  File. 
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Exhibit  9-13.  ORT  Sentinel  Analyses: 
Allowed  Charges  per  Medicare  Enrollee  for  Surgical  Dressings 

$8  ,  , 


$0  I  ^  

1993  1994  1995  1996 

Year 


Source:  HCFA  5%  Sample  of  the  100%  Durable  Medical  Equipment  (DME)  Standard  Analytic  File. 
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Exhibit  9-14.  ORT  Sentinel  Analyses: 
Allowed  Charges  per  Medicare  Enrollee  for  Nebulizers 


$0  I  

1993  1994  1995  1996 

Year 


Source:  HCFA  5%  Sample  of  the  100%  Durable  Medical  Equipment  (DME)  Standard  Analytic  File. 
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9.3.2    Estimated  Impacts  of  ORT 

Overall  ORT  Effects 

Across  the  five  demonstration  states,  ORT  was  associated  with  a  negative  but  not  statistically  significant 
impact  on  total  allowed  charges  (Exhibit  9-15).  In  the  1993-95  pre-ORT  period,  allowed  charges  per 
enrollee  increased  by  about  SI 6  per  year,  and  by  about  $14  per  year  in  ORT  states  (the  sum  of  the  overall 
time  trend  ($16)  and  the  differential  time  trend  observed  in  ORT  states  ($-6).  In  1996,  reimbursement 
levels  in  comparison  states  were  about  $6  less  than  the  level  implied  by  the  1993-95  time  trend,  and  about 
$12  less  in  ORT  states  (the  sum  of  the  ORT  year  and  ORT  impact  coefficients).  The  decrease  observed 
in  comparison  states  in  1996  may  be  the  result  of  ORT  spillover  effects,  or  reflect  the  efforts  of  other 
entities,  such  as  the  DMERCs,  to  control  DME  expenditures. 


Exhibit  9-15:  ORT  Sentinel  Analyses 

Regression  Models  for  Durable  Medical  Equipment:  Total  Allowed  Charges  per  Medicare 
Enrollee 

Total  allowed  charges  per  Medicare  enrollee  for: 

Incontinence        Surgical  Enteral  Nebulizer 

Variable  Total  DME       Supplies         Dressings        Nutrition  Drugs 


ORT  impact 

-5.90 

1.01* 

-1.40*** 

1.37 

-5.13** 

(across  all  five  ORT 

( 3.85) 

(0.61) 

(0.35) 

(3.67) 

(2.52) 

states) 

Time  trend  (Year) 

16.47*" 

-1 .06*** 

0.65*** 

-0.51 

0.32 

(0.96) 

(0.15) 

(0.09) 

(0.91) 

(0.63) 

ORT  year  (1996) 

-5.98** 

-1.02*** 

-1.66*** 

0.26 

1.18 

(2.44) 

(0.39) 

(0.22) 

(2.33) 

(1.60) 

Differential  time 

-2.04 

-1.26*** 

0.37*** 

-3.48** 

2.74*** 

trend:  ORT  states 

(1.51) 

(0.24) 

(0.14) 

(1.44) 

(0.99) 

Mean  of  dependent    175.29  4.73  1.98  15.90  8.44 

variable 

Sources:  HCFA  5%  Sample  for  the  100%  Durable  Medical  Equipment  Standard  Analytic  File 

Standard  errors  shown  In  parentheses 

*■• :    Statistically  significant  at  1%  level 
■"  :    Statistically  significant  at  5%  level 
Statistically  significant  at  10%  level 
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Turning  to  the  specific  types  of  DME  that  were  analyzed,  ORT  was  associated  with  a  negative  and 
significant  effect  on  allowed  charges  for  surgical  dressings  and  nebulizer  drugs.  The  estimated  impact  of 
ORT  on  allowed  charges  for  surgical  dressings  was  $1.40,  a  reduction  of  46%  from  the  1995  mean  of 
$3.05.  ORT  was  also  associated  with  a  reduction  of  more  than  $5  in  allowed  charges  for  nebulizer  drugs, 
also  a  large  and  statistically  significant  estimated  effect.  This  represents  about  50%  of  the  nationwide 
1995  average  of  approximately  SIO  per  enrollee.  The  estimated  impact  on  enteral  nutrition  charges  was 
not  statistically  significant. 

ORT  was  associated  with  a  positive  and  statistically  significant  (at  the  10%  level)  effect  of  ORT  on 
incontinence  supplies  costs.  This  result  was  driven  by  the  decrease  in  allowed  charges  for  incontinence 
supplies  in  the  pre-ORT  period  (Exhibit  9-11).  The  estimated  time  trend  for  incontinence  supply  charges 
was  negative,  and,  in  1996,  allowed  charges  in  comparison  states  were  even  lower  than  the  level  implied 
by  the  1993-95  time  trends. 

State-specific  ORT  Effects 

Across  all  types  of  DME,  when  ORT  effects  were  estimated  separately  for  each  demonstration  state,  ORT 
had  a  large,  negative  effect  in  Florida  (Exhibit  9-16).  ORT  was  associated  with  a  reduction  in  DME 
allowed  charges  per  enrollee  of  almost  $30  in  that  state.  This  represents  an  1 1  %  decline  from  Florida's 
1995  level  of  $282  per  enrollee.  In  the  other  four  states,  the  estimated  sentinel  effects  associated  with 
ORT  across  all  types  of  DME  were  small  and  not  statistically  significant. 

For  incontinence  supplies,  ORT  was  associated  with  a  large,  positive  effect  in  Texas.  Closer  analysis  of 
costs  for  incontinence  supplies  in  Texas  shows  that  the  estimated  positive  effect  reflects  the  large  decrease 
in  allowed  charges  for  incontinence  supplies  in  Texas  in  the  1993-95  pre-ORT  period^. 

The  positive  and  significant  Texas  ORT  coefficient  indicates  that  in  1996,  allowed  charges  did  not 
continue  to  fall  at  the  same  rate  as  they  had  in  the  pre-ORT  period,  when  Texas  had  much  higher  costs 
than  other  states  (Exhibit  9-11).  Costs  for  incontinence  supplies  fell  nationwide  in  1996  (in  comparison 
states,  allowed  charges  were  $1 .02,  or  29%,  less  than  the  level  implied  by  the  1993-95  time  trend).  There 
is  no  evidence  that  ORT  had  any  impact  on  the  rate  of  decrease  for  incontinence  supply  costs  in  the 
demonstration  states. 

The  previously  discussed  sentinel  effect  found  for  surgical  dressings  was  driven  by  large  estimated  ORT 
effects  in  Florida.  In  Florida,  ORT  was  associated  with  a  $4.50  reduction  in  allowed  charges  for  surgical 
dressings,  an  estimated  impact  of  more  than  50%.  The  impact  of  ORT  on  allowed  charges  for  surgical 
dressings  was  negative  in  the  other  four  demonstration  states,  but  significant  only  in  New  York. 

The  large  sentinel  effect  found  for  nebulizer  drugs  was  also  due  to  a  large  sentinel  effects  observed  in 
Florida.  The  magnitude  of  this  Florida  effect  was  remarkable:  over  S26  per  enrollee.  The  decrease 
constitutes  almost  a  50%  reduction  from  Florida's  1 995  level  of  $49  in  nebulizer  costs  per  enrollee. 


4      Specifically,  per  enrollee  incomirience-supplies  costs  fell  from  over  S15  in  1993  to  under  S5  in  1995. 
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Exhibit  9-16:  ORT  Sentinel  Analyses 

Regression  Models  for  Durable  Medical  Equipment:  Total  Allowed  Charges  per  Medicare 
Enroliee  by  State 

Total  allowed  charges  per  Medicare  enroliee  for 

Incontinence      Surgical  Enteral  Nebulizer 

Variable  Total  DME        Supplies        Dressings        Nutrition  Drugs 


ORT  impact  for: 


California 

0.75 

0.88 

-0.43 

-0.80 

-0.64 

(6.00) 

(0.95) 

(0.54) 

(5.72) 

(3.93) 

Florida 

-29.59*** 

-0.15 

-4.50*** 

7.67 

-26.16*** 

(6.90) 

Illinois 

4.00 

-1.68 

-0.88 

-0.44 

0.21 

(8.77) 

/ft  "^fi^ 

/S 

New  York 

-0.60 

1.40 

-1.12** 

-0.34 

0.53 

(6.10) 

(4.  00) 

Texas 

-4.24 

4.15*** 

-0.10 

1 .77 

-0.00 

(7.68) 

M  21^ 

(7 

Time  trend 

16.47*** 

-1 .06*** 

0.65*** 

-0.51 

0.32 

(Year) 

(0.92) 

(0  RR) 

(0  fill 

ORT  year  (1996) 

-5.98** 

-1.02*** 

-1.66*** 

0.26 

1.18 

(2.36) 

(0  37) 

(0  21) 

(2  25) 

(1  55) 

Differential  time  trend  in  ORT  states: 

California 

-8.82*** 

-0.68* 

0.22 

0.23 

-0.11 

(2.35) 

(0.37) 

(0.21) 

(2.24) 

(1.54) 

Florida 

12.10*** 

-0.54 

1.77*** 

-16.83*** 

15.11*** 

(2.71) 

(0.43) 

(0.24) 

(2.58) 

(1.77) 

Illinois 

-3.07 

-0.22 

0.14 

-0.24 

0.11 

(3.42) 

(0.54) 

(0.31) 

(3.26) 

(2.24) 

New  York 

-8.19*** 

-1.00*** 

-0.15 

-0.17 

-0.66 

(2.38) 

(0.37) 

(0.22) 

(2.27) 

(1.56) 

Texas 

3.26 

-4.42*** 

-0.09 

-1.24 

-0.17 

(3.01) 

(0.47) 

(0.27) 

(2.87) 

(1.98) 

Mean  dependent 

175.29 

4.73 

1.98 

15.90 

8.44 

variable 


Sources:  HCFA  5%  Sample  for  the  100%  Durable  Medical  Equipment  Standard  Analytic  File  Standard  errors  shown  in 
parentheses 

"' :    Statistically  significant  at  1%  level 
*■  :    Statistically  significant  at  5%  level 
Statistically  significant  at  10%  level 
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Fraud  and  abuse  for  nebulizer  drugs  was  a  major  priority  during  ORT.  and,  in  a  real  sense,  the  efforts 
undertaken  to  combat  fraud  in  this  area  represents  the  ORT  Partnership  model  at  its  best.  Data  analysis 
performed  by  the  Statistical  Analysis  Durable  Medical  Equipment  Regional  Carrier  (SADMERC) 
uncovered  evidence  of  fraudulent  and  collusive  billing  practices  by  a  large  number  of  suppliers  in  South 
Florida,  and  showed  that  DMERC  Region  C  accounted  for  67%  of  the  nationwide  payments  for  nebulizer 
drugs.  Efforts  by  staff  at  the  Miami  Field  Office  led  to  a  policy  change  in  the  Medicare  Carriers  Manual, 
which  stated  that  only  entities  licensed  to  dispense  prescription  drugs  (i.e.,  pharmacies)  could  bill  for 
nebulizer  drugs.  In  addition,  the  DMERC  introduced  an  edit  into  the  claims  processing  system  to  detect 
instances  when  Medicare  beneficiaries  were  being  billed  for  combinations  of  drugs  which  could  be 
harmful  if  taken  together. 

Spillovers  and  Diversions  Within  ORT  Regions 

To  test  whether  ORT  projects  led  either  to  sentinel  effects  in  nearby  States  (spillovers)  or  to  displacement 
of  fraud  from  the  ORT  States  to  their  neighbors  (diversion),  we  extended  the  regression  model  to  compare 
the  non-ORT  states  in  ORT  regions  to  the  comparison  states  not  in  ORT  regions. 

We  found  no  evidence  that  non-ORT  states  in  ORT  regions  differed  from  comparison  states  in  their  total 
DME  charges,  as  the  estimated  impact  of  being  a  non-ORT  state  within  an  ORT  region  was  not  associated 
with  a  significant  change  in  total  DME  allowed  charges  per  enroUee.  We  conclude  that  any  net  spillover 
or  diversion  in  this  service  area  was  no  different  in  ORT  regions  than  in  non-ORT  regions. 

9.4    Nursing  Home  Sentinel  Analyses 

One  reason  nursing  homes  are  vulnerable  to  fraud  is  that  the  Medicare  reimbursement  system  pays  for 
nursing  home  services  under  both  Parts  A  and  B,  making  it  is  more  difficult  for  DHHS  to  identify  and 
investigate  inappropriate  provider  activities.  This  structural  vulnerability  is  compounded  by  the  lack  of 
regulation  of  DME  sales  representatives  by  DHHS,  poor  oversight  of  the  nursing  home  supply  inventories 
(e.g.,  to  detect  stockpiling  of  supplies  by  nursing  homes),  and  beneficiaries'  lack  of  awareness  of  items 
billed  under  their  Medicare  health  insurance  claim  (HIC)  numbers. 

DME  suppliers  have  been  implicated  in  much  of  the  nursing  home  fraud  and  abuse  that  has  been  identified 
by  the  OIG.  While  Medicare  does  not  cover  many  types  of  DME  for  nursing  home  patients,  covered  items 
in  nursing  homes  include  surgical  dressings,  incontinence  appliances  and  care  supplies,  orthotic  and 
prosthetic  devices,  ostomy  supplies,  and  enteral  nutrition.  It  was  therefore  natural  in  our  analysis  to 
hypothesize  that  —  in  addition  to  its  impact  on  DME  in  general  —  ORT  would  specifically  reduce  charges 
for  DME  used  by  Medicare  recipients  in  nursing  homes. 
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9.4.1     General  Trends 


Over  the  1993-95  time  period,  mean  allowed  SNF-DME  charges  in  the  180-days  following  a  Medicare- 
covered  SNF  admission  were  about  $400  in  comparison  states,  but  substantially  higher  in  the  ORT  states 
(Exhibit  9-17).  Allowed  charges  in  several  ORT  States,  especially  New  York,  declined  markedly  in  the 
pre-ORT  period.  Hence  this  does  not  appear  to  be  an  area  in  which  large  sentinel  effects  could  be 
anticipated,  given  that  charges  were  already  declining  in  the  pre-ORT  period. 

9.4.2    Estimated  Impacts  of  ORT 

Our  central  analysis  was  a  model  which  included  fixed  effects  for  each  MSA,  a  time  trend,  a  differential 
time  trend  for  MSAs  in  the  ORT  States,  an  ORT  period  indicator,  and  an  ORT  indicator  (i.e.,  the 
observation  was  from  MSA  in  an  ORT  State  in  1996). 

Overall  ORT  Effects 

For  the  five  ORT  States  as  a  group,  there  was  no  significant  sentinel  effect  (Exhibit  9-18).  For  example, 
in  the  pre-ORT  period,  180-day  DME  charges  per  SNF  admission  grew  slowly  at  $2  per  year  in  the  non- 
ORT  States.  In  the  ORT  States  in  this  same  period,  they  were  declining  at  a  rate  of  $4  per  year  ($2  -  $  6 
=  -$4).  While  charges  in  non-ORT  States  in  1996  were  S8  above  the  trend  line,  average  charges  in  the 
ORT  States  in  1996  were  $30  below  the  ORT  State  trend  line;  the  S38  differential  was  not  statistically 
significant.  A  similar  but  scaled-down  pattern  of  coefficients  was  seen  for  allowed  charges  in  the  90-day 
window:  the  ORT  effect  of  -  $16  was  not  statistically  significant. 

About  half  of  all  SNF  stays  incur  some  DME  charges  within  90  days,  and  57  percent  do  so  within  180 
days.  These  proportions  increased  by  one  to  two  percentage  points  per  year  over  the  pre-ORT  period,  and 
then  declined  in  1996  in  both  ORT  and  non-ORT  States.  The  ORT  effect  was  small  and  not  statistically 
significant. 

State-specific  ORT  Effects 

When  the  States  are  examined  separately,  however,  a  more  interesting  story  emerges.  As  noted  earlier, 
the  pre-ORT  trends  in  the  individual  ORT  States  are  strongly  negative  in  one  State  (New  York),  mildly 
negative  in  two  others  (Illinois  and  Texas),  and  positive  in  the  remaining  two  (California  and  Florida) 
(Exhibit  9-19). 

While  average  1 80-day  charges  in  four  of  the  ORT  States  in  1996  lie  not  too  far  off  the  trend  line  adjusted 
for  the  $8  1996  year  effect,  a  major  negative  impact  is  seen  for  Florida:  $208,  statistically  significant  at 
the  level.  The  Florida  effect,  which  relative  to  the  national  mean  represents  a  47  percent  reduction, 
is  partially  accounted  for  by  a  statistically  significant  reduction  of  6.3  percentage  points  (around  a  national 
mean  of  57'y^  in  the  proportion  of  SNF  admissions  with  any  associated  DME  charges. 
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Exhibit  9-17.  ORT  Sentinel  Analyses: 
Allowed  DME  Charges  Per  (Within  180  Days  of)  Medicare  SNF  Admission 
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Note:  This  chart  is  based  on  data  for  SNF  admissions  during  the  first  6  months  of  each  calendar  year. 

bource:  ML.r-M  ovo  bampie  or  me  iuu7o  uuraoie  ivieaicai  tquipment  luivit;  bianaara  Analytic  i-iie;  ana  dvo  sample  SNF  Standard  Analytic  File. 


Abt  Associates  Inc. 


Appendix  9:  Sentinel  Effects  of  ORT 


9-29 


Exhibit  9-18:  ORT  Sentinel  Analyses 

Regression  Models  for  Durable  Medical  Equipment  in  Skilled  Nursing  Facilities 


1 80-Day  Window  After  SNF      90-Day  Window  After  SNF 
Admission  Admission 


Mean  allowed  Any  allowed  Mean  allowed    Any  allowed 
Variable  charges         charges         charges  charges 


ORT  impact  (across  all 

-$37.56 

-0.009 

-15.58 

-0.0086 

five  ORT  states) 

(31.11) 

(0.0120) 

(14.91 

(0.0105) 

Time  trend  (Year) 

1.91 

0.0187*" 

4.96 

0.0199*** 

(8.26) 

(0.0031) 

(3.85) 

(0.0027) 

ORT  year  (1996) 

7.67 

-0.0142* 

-2.93 

-0.0185*** 

(19.83) 

(0.0074) 

(9.23) 

(0.0065) 

Differential  time  trend  in 

-6.23 

-0.0062 

-0.62 

-0.0052 

ORT  states 

(13.30) 

(0.0050) 

(6.20) 

(0.0044) 

Mean  of  dependent  $440.  57%  $238.  51% 

variable 

Sources  HCFA  5%  SNF  Standard  Analytic  File;  HCFA  5%  sample  for  the  100%  Durable  Medical  Equipment 
Standard  Analytic  File. 

Standard  errors  shown  in  parentheses 

*'* :  Statistically  significant  at  1%  level 
**  :    Statistically  significant  at  5%  level 

:    Statistically  significant  at  10%  level  
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Exhibit  9-19:  ORT  Sentinel  Analyses 

Regression  Models  for  Durable  Medical  Equipment  in  Skilled  Nursing  Facilities 


180-Day  Window  After  SNF      90-Day  Window  After  SNF 
Admission  Admission 

Mean  allowed    Any  allowed  Mean  allowed    Any  allowed 
Variable  charges  charges  charges  charges 


ORT  impact  for: 


California 

-55.06 

-.0183 

-18.52 

-.0107 

(49.24) 

(.0188) 

(22.91) 

(.0165) 

Florida 

-208.32*** 

-.0630*** 

-88.44*** 

-.0581*** 

(58.49) 

(.0223) 

(27.07) 

(.0195) 

Illinois 

16.21 

.0305 

-2.24 

.0151 

(68.33) 

(.0261) 

(31.54) 

(.0228) 

New  York 

62.65 

.0228 

32.93 

.0107 

(61.69) 

(.0236) 

(28.67) 

(.0207) 

Texas 

53.04 

.0043 

21.71 

.0127 

(60.88) 

(.0233) 

(28.25) 

(.0204) 

Time  trend  (Year) 

1.91 

.0187*** 

4.96 

.0199*** 

(8.12) 

(.0031) 

(3.76) 

(.0027) 

ORT  year  (1996) 

7.67 

-.1422* 

-2.93 

-.0185*** 

(19.49) 

(.0074) 

(9.01 1) 

(.0065) 

Differential  time  trend  in  ORT  states: 

California 

26.28 

-.0019 

15.37* 

-.0030 

(19.82) 

(.0076) 

(9.20) 

(.0066) 

Florida 

45.92* 

.0105 

28.74** 

.0098 

(24.50) 

(.0093) 

(11.30) 

(.0082) 

Illinois 

-20.11 

-.0247 

-2.16 

-.0173 

(28.79) 

(.0110) 

(13.28) 

(.0096) 

New  York 

-92.67*** 

-.0164* 

-49.62*** 

-.0091 

(25.88) 

(.0099) 

(12.02) 

(.0087) 

Texas 

-29.37 

-.0082 

-14.74 

-.0130 

(26.18) 

(.0010) 

(12.11) 

(.0087) 

Mean  of  dependent        $440  57%  $238  51% 

variable 


Sources  HCFA  5%  SNF  Standard  Analytic  File;  HCFA  5%  of  the  100%  Durable  Medical  Equipment  Standard 
Analytic  File. 

Standard  errors  stiown  in  parentheses 

:    Statistically  significant  at  1  %  level 
••  :    Statistically  significant  at  5%  level 
Statistically  significant  at  10%  level 
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Spillovers  and  Diversions  Within  ORT  Regions 


To  test  whether  ORT  projects  led  either  to  sentinel  effects  in  nearby  States  (spillovers)  or  to  displacement 
of  fraud  from  the  ORT  States  to  their  neighbors  (diversion),  the  models  were  re-estimated  with  ORT 
regions  replacing  ORT  States,  and  with  the  five  ORT  States  deleted.  A  positive  coefficient  for  an  ORT 
region  would  indicate  that  diversion  was  occurring;  i.e.,  that  charges  were  higher  than  expected  in  non- 
ORT  States  in  ORT  regions.  Conversely,  a  negative  coefficient  would  indicate  a  spillover  of  the  ORT 
sentinel  effects. 


There  was  little  evidence  of  either  net  spillovers  or  net  diversions  for  SNF-DME  charges.  The  estimated 
effects  for  mean  90-  and  1 80-day  allowed  charges  were  generally  small  and  statistically  insignificant 
(Exhibit  9-20).  The  only  region  for  which  the  estimated  impact  exceeded  the  standard  error  was  Region 
6,  which  includes  Texas  (an  ORT  State)  and  Arkansas,  New  Mexico,  and  Oklahoma  (comparison  States). 
It  will  be  recalled  that  Louisiana,  which  is  also  in  Region  6,  was  excluded  from  the  analysis. 

DME  charges  in  the  180-day  period  following  SNF  admission  were  $144  higher  in  MS  As  in  Arkansas, 
New  Mexico,  and  Oklahoma  (i.e.,  HCFA  Region  VI)  in  1996  than  would  otherwise  have  been  expected 
{p  <  0. 10).  This  suggests  that  ORT  activities  in  Texas — and  possibly  Louisiana — may  have  allowed  some 
additional  costs  to  be  accrued  in  other  States  in  the  region. 


Exhibit  9-20:  ORT  Sentinel  Analyses 
Spillovers  and  Diversions: 

Estimated  Effects  on  Mean  SNF-DME  Allowed  Charges 


Variable 


180-Day  Window 
After  SNF 
Admission 


90-Day  Window 
After  SNF 
Admission 


ORT  impact  for: 

Region  XI  (California) 
Region  IV  (Florida) 
Region  V  (Illinois) 
Region  VI  (New  York) 
Region  VI  (Texas) 


101.44 
46.91 
24.29 
-25.48 
144.41* 


35.88 
-2.63 
-7.14 
83.41 
-4.54 


Sources  HCFA  5%  SNF  Standard  Analytic  File;  HCFA  5%  of  the  100%  Durable 
Medical  Equipment  Standard  Analytic  File. 

Standard  errors  shown  in  parentheses 

•  :  Statistically  significant  at  10°o  level  
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9.5    Conclusions:  Did  ORT  Generate  Sentinel  Effects? 


The  sentinel  analysis  set  for  itself  a  plainly  ambitious  goal  —  that  of  quantifying  behavior  deterred  as  a 
result  of  ORT.  The  analysis  itself  required  specification  of  a  counterfactual,  an  assumption  about  how 
providers  would  have  behaved  had  ORT  never  occurred.  Confidence  in  any  given  counterfacnjai  is  always 
difficult  to  achieve  since  it  is  by  definition  an  assertion  about  events  or  processes  that  were  never  observed. 
ORT  itself  did  not  arise  spontaneously  but  was  the  product  of  an  increasing  awareness  of  fraud  and  abuse 
and  was  not  the  only  initiative  designed  to  combat  it.  The  analytic  plan  underlying  the  results  reported  here 
relied  on  a  conservative  counterfactual.  It  assumed  that  in  the  absence  of  ORT,  the  behavior  of  providers 
in  ORT  states  in  1996  would  bear  the  same  relationship  to  the  behavior  of  providers  in  non-ORT  states 
in  1 996  as  it  had  in  previous  years.  It  further  assumed  that  the  behavior  of  providers  in  non-ORT  states 
was  unaffected  by  ORT. 

The  analyses  described  previously  estimated  sentinel  effects  very  conservatively,  assuming  that  none  of 
the  decrease  or  levelling  off  of  rapid  growth  observed  in  the  comparison  states  in  1996  was  due  to  ORT. 
Furthermore,  several  of  the  outcome  measures  analyzed  here  were  already  falling  rapidly  in  ORT  states 
during  the  pre-ORT  period.  The  methodology  used  required  the  decline  to  continue  at  the  same  rate  or 
greater  in  1996  in  order  to  find  an  ORT  sentinel  effect.  Under  this  assumption,  statistically  significant 
sentinel  effects  were  found  for  some  highly  focused  outcomes  in  specific  ORT  states,  but  not  for  the 
broader  outcomes  in  all  five  states  combined.  Significant  effects  were  found  on:  visits  per  beneficiary 
among  agencies  with  especially  high  rates  in  1 994  or  1 995  for  all  ORT  states  combined  and  for  California; 
allowed  charges  for  surgical  dressings,  for  all  states  combined,  Florida,  and  New  York;  allowed  charges 
for  nebulizer  drugs,  for  all  states  combined  and  Florida;  average  allowed  DME  charges  within  90  days  and 
within  1 80  days  of  a  Medicare-covered  SNF  admission,  for  Florida,  and  proportion  of  Medicare-covered 
SNF  admissions  with  any  allowed  DME  charges  within  90  days  and  within  1 80  days,  for  Florida.  .Across 
all  analyses,  the  great  majority  of  estimated  impacts  were  negative,  but  not  statistically  significant  at 
conventional  levels.  While  one  cannot  infer  from  a  single  statistically  insignificant  coefficient  that  a  real 
effect  has  occurred,  the  consistent  pattern  of  negative  coefficients  across  the  ORT  states  and  outcome 
measures  is  highly  suggestive. 

The  estimation  method  can  be  seen  graphically  in  Exhibit  9-21  below  which  captures  the  essential 
elements  of  the  models  estimated  here  while  exaggerating  some  distances  and  slopes  for  clarity.  The  path 
of  each  measure  of  utilization  in  ORT  and  non-ORT  states  was  fit  to  a  linear  trend  using  data  from  1992- 
1 995.  This  resulted  in  estimated  trends  given  by  the  line  AB  for  non-ORT  states  and  by  EF  for  ORT  states. 
Let  us  say  that  in  1996,  utilization  dropped  below  this  trend  by  the  amount  CD  in  non-ORT  states  and  by 
the  amount  GI  in  ORT  states.  According  to  the  counterfactual  we  have  employed,  the  estimated  effect  of 
ORT  is  the  amount  GI  (the  decline  in  utilization  in  1996  in  ORT  stales)  minus  the  amount  CD  (the  1996 
decline  in  non-ORT  states).  That  is.  we  assume  that  utilization  would  have  fallen  by  the  amount  GH 
(which  is  drawn  to  be  equal  to  CD)  in  ORT  states  even  in  the  absence  of  ORT.  Therefore  only  the 
difference,  GI-GH=:HI,  is  counted  as  an  ORT  effect. 
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Exhibit  9-21  ORT  Sentinel  Analyses: 
Estimation  of  Sentinel  Effects 


0) 

« 


UJ 

£ 
S 
1 

« 

Q. 

M 

o 
O 


1993 


1994 


1995 


1996 


Year 


A-B:  Comparison  state  pre-ORT  time  trend 
B-C:  Projected  growth  rate  for  1996 
B-D:  Actual  growth  rate  for  1996 


E-F:  ORT  state  pre-ORT  time  trend 
F-G:  Projected  growth  rate  for  1996 
G-l:  Actual  growth  rate  for  1996 
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This  approach,  relying  as  it  does  on  a  second-order  "difference  in  differences"  to  estimate  the  ORT  effect, 
is  conservative  in  its  efforts  to  insure  that  no  extraneous  influences  are  mistakenly  identified  as  arising 
from  ORT.  The  consequences  of  the  conservative  approach  are  that  1 )  the  overall  effect  of  ORT  may  be 
grossly  underestimated  if  its  effects  on  behavior  were  not  limited  to  providers  in  ORT  states,  and  2)  the 
precision  with  which  ORT  effects  are  estimated  is  substantially  reduced  because  differencing  causes  the 
variance  of  estimators  to  grow. 

The  estimated  sentinel  effects  using  the  models  in  which  ORT  states  were  pooled  are  expressed  in  Exhibit 
9-22  below  as  a  percent  of  the  mean  value  of  the  appropriate  utilization  measure.  While  all  of  the  estimates 
are  negative,  as  expected,  none  meet  accepted  standards  of  statistical  significance.  Hence  there  is  no  way 
of  knowing  whether  they  are  indicative  of  true  sentinel  effects,  obscured  by  background  variation  in 
utilization  or  are  simply  the  result  of  random  sampling  error.  Although  the  sign  and  magnitude  of  the 
numbers  in  Exhibit  9-22  seem  like  reasonable  estimates  of  ORT  sentinel  effects,  under  the  chosen 
counterfactual  there  is  no  basis  for  asserting  that  ORT  produced  any  sentinel  effects  at  all. 


Exhibit  9-22:  ORT  Sentinel  Analyses 

Estimated  Sentinel  Effects  Using  Double  Difference  Method 

Home  Health 
Reimbursement 
per  Beneficiary 

Home  Health 
Visits  per 
Beneficiary 

Total  Allowed       180-Day  Allowed 
DME  Charges  per    Charges  for  DME 
Beneficiary               in  SNF 

90-Day  Allowed 
Charges  for 
DME  in  SNF 

-1 .4% 

-1.3% 

-3.4%  -8.5% 

-6.5% 

Exhibit  9-5, 
col  1 

Exhibit  9-6, 
col  1 

Exhibit  9-15,            Exhibit  9-20, 
col  1                      col  1 

Exhibit  9-20, 
col  3 

Note:  None  of  the  estimates  are  statistically  significant  at  conventional  levels. 

At  this  point  it  is  appropriate  to  speculate,  at  least  briefly,  about  the  likely  size  of  estimated  sentinel  effects 
under  a  different  counterfactual.  Rather  than  assuming  that  providers  in  ORT  states  would,  in  the  absence 
of  ORT,  have  altered  their  behavior  in  1996  in  the  same  way  that  providers  in  non-ORT  states  did,  let  us 
assume  instead  that  providers  in  ORT  and  non-ORT  states  would,  in  the  absence  of  ORT,  have  continued 
to  follow  their  pre-existing  trend.  This  is  a  broader  and  looser  counterfactual.  It  drops  the  assumption  that 
providers  in  non-ORT  states  were  unaffected  by  ORT."  If  the  earlier  counterfactual  was  conservative  in 
its  efforts  to  assure  that  no  extraneous  influences  were  counted  as  ORT  effects,  this  one  risks  confounding 
ORT  effects  with  a  variety  of  economy-wide  and  industry-level  events. 

Under  this  new  construction,  the  sentinel  effect  is  given  by  the  (weighted)  average  of  the  amount  CD  for 
non-ORT  slates  and  the  amount  GI  for  ORT  states.  It  is  computed  by  estimating  a  simpler  model  than  was 
employed  earlier.  The  ORT  effect  is  expressed  as  the  1996  deviation  of  the  predicted  value  of  the 
utilization  measure  Y  in  each  MSA  from  its  state-specific  linear  trend.  It  is  written  as 

Y„  =  [Fixed  effects]  +  a,(YEAR,  -  1992)'STATE  +  a^ORTYEAR, 


The  failure  to  find  significant  differences  in  utilization  between  non-ORT  states  in  ORT  regions  and  states  in  non-ORT  regions  implies 
either  that  no  spillover  effects  occurred  (as  the  doutile-difference  model  assumes)  or  that  spillover  was  essentially  complete  (as  the  pre- 
posl  model  assumes) 
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The  sentinel  effect  is  now  estimated  by  the  "pre-post"  coefficient  a^.  This  model  was  estimated  for  the 
same  utilization  variables  reported  in  Exhibit  9-22.  Exhibit  9-23  displays  the  estimated  sentinel  effect 
under  the  new  counterfactual,  once  again  as  a  percentage  of  the  appropriate  dependent  variable. 


Exhibit  9-23:  ORT  Sentinel  Analyses 

Estimated  Sentinel  Effects  Under  Alternative  Counterfactual  (Pre-Post  Method) 

Home  Health 

Home  Health 

Total  Allowed 

1 80-Day  Allowed 

90-Day  Allowed 

Reimbursement 

Visits  per 

DME  Charges 

Charges  for  DME 

Charges  for  DME 

per  Beneficiary 

Beneficiary 

per  Beneficiary 

in  SNF 

in  SNF 

-13.0%" 

-6.6%" 

-4.5%" 

-1 .2% 

-3.3% 

Note:  "  Estimate  is  statistically  significant  at  0.05  significance  level. 

Using  the  new  counterfactual,  sentinel  effects  for  home  health  are  much  larger  than  previously  estimated 
and  are  statistically  significant.  The  sentinel  effect  for  DME  is  identical  to  its  earlier  estimate  but  is  now 
statistically  significant.  The  effect  for  DME  delivered  to  nursing  home  residents  is  lower  in  magnitude  and 
remains  statistically  insignificant.  This  alternate  approach  is  not  necessarily  the  most  realistic  approach 
to  follow.  It  is,  instead,  simply  a  better  way  to  its  detect  the  sentinel  effects  of  ORT  -i-  complementary 
initiatives,  if  such  effects  do  in  fact  exist.  But  there  is  a  price  to  pay:  the  alternate  method  increases  the 
likelihood  of  finding  significant  effects  where  in  fact  there  are  none.  One  way  to  think  of  these  alternate 
findings  is  that,  by  relaxing  our  more  restrictive  assumptions,  they  represent  an  upper  bound  on  the  likely 
sentinel  effects  that  actually  occurred. 

The  alternative  counterfactual  provides  a  much  firmer  suggestion  of  sentinel  effects,  at  least  for  home 
health  and  DME  outside  of  nursing  homes.  But  can  we  trust  the  alternative  counterfactual?  It  is,  of  course, 
impossible  to  be  definitive  on  the  subject.  Nevertheless  it  seems  entirely  reasonable  to  assert  that  ORT 
affected  the  behavior  of  providers  in  non-ORT  states  as  much  or  almost  as  much  as  that  of  providers  in 
ORT  states.  By  1996,  audits  and  investigations  of  home  health  agencies  and  DME  suppliers  were 
prominently  featured  in  the  trade  press.  To  our  knowledge,  none  of  these  articles  or  reports  suggested  that 
providers  outside  the  five  ORT  states  were  in  any  way  protected  from  such  investigations.  Furthermore, 
most  of  the  non-ORT  influences  on  Medicare  utilization,  at  least  those  that  one  can  easily  name  such  as 
trends  in  managed  care,  legislated  alterations  in  benefits,  or  changes  in  the  demographic  composition  of 
the  Medicare  population,  did  not  exhibit  evident  sharp  changes  in  1996.  Moreover,  some  of  the  most 
visible  forces  affecting  providers  were  efforts  other  than  ORT  aimed  at  controlling  fraud  and  abuse.  These 
include  the  work  of  the  South  Florida  Task  Force,  the  DME  Regional  Carriers  and  other  activities  carried 
out  by  Medicare  carriers  and  fiscal  intermediaries.''  So  it  is  not  unreasonable  to  suggest  that  ORT  may 
well  have  been  the  salient  influence  leading  home  health  and  DME  providers  to  alter  their  behavior  in 
1996.  By  extension,  the  sentinel  effects  reported  in  Exhibit  9-23  have  a  credible  claim  to  believability, 
although  they  must  surely  be  regarded  as  upper  bounds  to  the  true  sentinel  effect. 

Where  does  this  leave  us?  If  we  insist  on  a  strict  statistical  standard,  then  the  analyses  reported  in  this 
chapter  cannot  reject  the  hypothesis  that  ORT  had  no  sentinel  effects  using  a  conservative  counterfactual. 
Under  a  looser  alternative  counterfactual,  such  as  one  that  ascribed  half  of  the  observed  1996  deviation 


6       We  can  make  no  claim  to  be  able  lo  discnminate  the  effects  of  ORT  from  the  effects  of  these  other  efforts  since  all  were  initialed  at 
roughly  the  same  time. 


Abt  Associates  Inc. 


Appendix  9:  Sentinel  Effects  of  ORT 


9-36 


from  trend  to  ORT,  sentinel  effects  of  three  to  seven  percent  for  home  health  care  and  about  two  percent 
for  DME  outside  of  nursing  homes  are  worth  serious  attention.  Given  the  level  of  Medicare  expenditure 
for  these  services,  the  conjecnired  sentinel  effects  are  more  than  sufficient  to  claim  a  positive  net  benefit 
for  Operation  Restore  Trust. 


Abt  Associates  Inc. 


Appendix  9:  Sentinel  Effects  of  ORT 


9-37 


Appendix  10 
Resources  and  Special  Topics 


10.1  The  Resources  Devoted  to  Operation  Restore  Trust 

10.1.1  Overview 

This  summary  describes  the  resources  that  were  devoted  to  Operation  Restore  Trust.  Against  these 
resources  must  be  balanced  the  benefits  that  resulted  from  the  demonstration,  as  detailed  elsewhere  in  this 
report. 

No  single  measure  is  appropriate  for  the  resources  devoted  to  Operation  Restore  Trust.  The  ORT  "budget" 
was  S7.9  million.  Of  this  total,  we  can  document  spending  of  $7.6  million  on  ORT  activities.  The 
remaining  $0.3  million  may  have  been  spent  on  ORT  activities  (it  was  transferred  back  from  OIG  to 
HCFA  to  fund  ORT  contractor  efforts).  But  after  repeated  inquiries  to  HCFA,  we  could  not  document 
that  the  expenditure  of  these  funds  was  ORT-related,  so  we  do  not  include  those  funds  in  the  ORT  total. 

The  nature  of  this  demonstration  explains  the  discrepancy  between  "the  ORT  budget"  and  the  total 
resources  used.  The  federal  government  funds  many  demonstrations  per  year,  and  the  task  of  comparing 
the  costs  and  benefits  of  these  demonstrations  ranges  from  straightforward  to  complex.  The  task  is  most 
straightforward  when  the  federal  government  transfers  funds  to  a  single  outside  entity,  which  then  devotes 
its  entire  effort  to  an  activity  that  previously  had  not  been  undertaken. 

Such  simple  circumstances,  of  course,  did  not  apply  to  Operation  Restore  Trust.  Under  ORT,  the  federal 
government  funded  itself  to  carry  out  disparate  activities  that  have  been  carried  out  for  years  by  hundreds 
of  officials  in  several  agencies.  With  or  without  Operation  Restore  Trust,  these  activities  would  have  had 
immediate  and  future  financial  benefits  to  the  Medicare  and  Medicaid  programs. 

Throughout  this  report  we  have  tried  to  describe  both  the  total  magnitude  of  these  benefits  as  well  as  the 
increase  that  resulted  from  Operation  Restore  Trust.  In  this  section  we  describe  the  total  magnitude  of 
the  resources  devoted  to  ORT  as  well  as  the  increase  in  those  resources  that  occurred  during  the 
demonstration.  No  precise  answers  are  possible  to  the  questions  of  how  the  increase  in  benefits  compared 
with  the  increase  in  costs  or  how  the  total  benefits  compared  with  the  total  costs.  Although  it  is  possible 
to  be  relatively  precise  in  comparing  the  increase  in  costs,  with  total  financial  benefits,  such  a  comparison 
would  be  specious. 

As  shown  in  Exhibit  10-1,  any  definition  of  the  resources  devoted  to  Operation  Restore  Trust  would 
include  the  ORT  budget,  which  cleariy  represented  an  increase  in  resources  devoted  to  combating  fraud 
and  abuse.  After  that,  a  series  of  increasingly  broad  definitions  are  appropriate.  These  expanding 
definitions  recognize  additional  costs  that  should  be  attributed  to  ORT. 
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Exhibit  10-1 

Resources  Devoted  to  Operation  Restore  Trust 
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•  Additional  OIG  personnel.  During  ORT  the  Office  of  Inspector  General  hired  29  personnel 
to  work  solely  on  ORT  projects.  This  expense  did  not  come  from  the  formal  ORT  budget, 
but  it  did  represent  a  clear  increase  in  resources. 

•  A  sense  of  priority.  Operation  Restore  Trust  was  a  clearly  designated  priority  for  the 
Department  of  Health  and  Human  Services.  Such  a  designation  is  not  customarily  thought 
of  as  a  "resource,"  but  we  believe  that  it  should  be. 

•  Efforts  of  existing  HHS  personnel.  Officials  of  the  participant  agencies — OIG,  HCFA  and 
AoA — devoted  many  thousands  of  hours  to  Operation  Restore  Trust  activities.  A  large 
proportion  of  these  hours  (and  of  related  expenses  such  as  supplies)  would  have  been  devoted 
to  fraud  and  abuse  activities  regardless  of  ORT. 

•  Efforts  of  other  organizations.  Officials  of  other  federal  and  state  agencies  and  staff  of 
Medicare  contractors  also  devoted  substantial  time,  almost  certainly  in  the  thousands  of  hours, 
to  ORT  activities.  Much  of  this  work  would  have  been  done  with  or  without  ORT,  but  the 
efforts  of  some  of  the  state  agencies  in  particular  represented  new  effort. 

Because  of  these  different  resources,  the  total  resource  cost  of  Operation  Restore  Trust  cannot  be  estimated 
with  any  confidence.  It  is  clear,  however,  that  the  single  largest  resource  cost  was  the  personnel  of  the 
ORT  participant  agencies  (Section  10.1.5  below),  which  was  several  times  larger  than  the  ORT  budget 
itself  The  magnitude  of  the  personnel  cost  contributed  by  organizations  outside  HHS  was  probably  in  the 
millions  of  dollars,  though  it  is  difficult  to  say  whether  it  was  greater  or  less  than  the  ORT  budget.  The 
cost  of  the  additional  OIG  personnel  was  at  least  $3  million  and  probably  more.  The  sense  of  priority 
accorded  to  ORT  does  not  have  a  dollar  cost,  of  course.  But  it  is  important  to  emphasize  that  ORT  used 
one  of  the  scarcest  resources  in  any  organization:  high  level  attention.  This  attention  was  one  of  the 
special  conditions  of  Operation  Restore  Trust  that  will  be  difficult  to  sustain  now  that  the  demonstration 
is  over. 

In  the  following  sections  we  provide  further  detail  on  the  resources  applied  to  Operation  Restore  Trust, 
their  magnitude  and  their  impacts. 

10.1.2  The  ORT  Budget 

These  resources  comprise  the  $7.6  million  that  was  actually  spent  on  activities  that  we  can  document  are 
related  to  ORT,  out  of  the  S7.9  million  formally  transferred  from  the  Medicare  trust  funds  to  the 
Department  of  Health  and  Human  Services  for  this  demonstration.  This  S7.6  million  was  clearly  ORT- 
related  and  is  an  unambiguous  increase  in  the  resources  devoted  to  controlling  fraud  and  abuse.  It  is  the 
minimum  cost  of  ORT  by  any  definition. 

The  funding  was  unusual  in  that  was  it  was  not  appropriated  by  Congress.  The  transfer  from  the  Medicare 
trust  funds  was  possible  because  of  a  provision  in  the  Medicare  program's  original  enabling  legislation, 
the  Social  Security  Amendments  of  1967,  that  allows  the  Secretary  of  Health  and  Human  Services  to  use 
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trust  fund  money  to  develop  or  demonstrate  improved  methods  for  investigating  or  prosecuting  fraud.' 
Operation  Restore  Trust  was  the  first  time  this  sub-paragraph  was  invoked. 

By  chance,  the  fact  that  the  funds  were  not  appropriated  proved  to  be  very  useful  during  the  government 
shutdowns  in  1995-96,  when  appropriated  funds  for  travel  and  other  expenses  were  either  unavailable  or 
very  tightly  restricted.  Many  regional  officials  emphasized  this  point  to  us. 

The  ORT  budget  was  divided  among  the  three  agencies  at  the  central  office  level.  The  Office  of  the 
HCFA  Administrator  controlled  disbursements,  even  though  two-thirds  of  the  ORT  budget  went  to  the 
Office  of  Inspector  General.  An  unusual  situation  therefore  occurred  in  which  millions  of  dollars  of 
spending  by  one  agency  was  effectively  controlled  by  another  agency.  HCFA  used  this  arrangement  in 
the  summer  of  1995  and  the  summer  of  1996  to  obtain  the  OIG's  cooperation  on  some  questions  about 
how  to  carry  out  Operation  Restore  Trust.  Regardless  of  the  details  of  this  particular  set  of  negotiations, 
we  note  that  the  control  of  funds  by  one  agency  probably  encouraged  the  participant  agencies  to  move  in 
the  same  direction — even  if  there  was  disagreement  on  what  that  direction  should  be. 

Once  the  funds  had  been  allocated  by  agency,  they  were  allocated  by  region  in  response  to  requests  from 
each  agency's  regional  office.  There  was  therefore  a  dichotomy  between  the  ORT  goal  of  encouraging 
teamwork  at  the  regional  level  and  the  continuation  of  agency-specific  funding  streams,  with  little  latitude 
at  the  regional  level  to  redirect  funds  across  agencies.  An  alternative  approach — which  we  would  not 
necessarily  recommend — would  have  been  for  the  three  central  offices  to  agree  on  an  allocation  by  region 
and  then  have  regional  officials  agree  on  which  projects  the  allocation  should  fund.  Such  an  approach 
would  have  empowered  the  regional  ORT  teams  but  would  have  represented  a  substantial  change  in 
traditional  ways  of  doing  business. 

ORT  spending  figures  are  shown  in  Exhibit  10-2  by  agency  and  by  type  of  spending  (i.e.,  object  class)  and 
in  Exhibit  10-3  by  agency  and  by  region.  Exhibit  10-4  is  a  graph  showing  spending  by  type  and  Exhibit 
10-5  shows  spending  by  agency  and  by  region.  The  highlights  of  spending  from  the  ORT  budget  were 
as  follows. 

•  No  funds  were  spent  on  salaries  and  other  personnel  expenses.  The  ORT  budget  covered 
only  non-personnel  costs  such  as  travel,  rental,  equipment  and  supplies.  Very  minor  amounts 
of  funds  were  used  for  personal  services  contracts. 

•  Two-thirds  of  the  budget  was  spent  by  OIG.  The  Office  of  Inspector  General  spent  S5.2 
million  (68%  of  the  total)  while  HCFA  spent  $2.2  million  (29%)  and  the  Administration  on 
Aging  $0.2  million  (3%).  The  three  agencies  therefore  were  far  from  equal  in  the  resources 
they  had  at  their  disposal. 

•  Essentially  no  funds  went  to  Medicare  contractors.  The  contractors  were  the  most  notable 
exclusion  from  Operation  Restore  Trust  funding.  HCFA's  contracts  with  its  fiscal 
intermediaries  and  carriers  call  for  them  to  maintain  fraud  control  units.  These  units  are 
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Exhibit  10-2 


Spending  of  the  Operation  Restore  Trust  Budget,  by  Type  of  Spending,  in  Thousands  of  Dollars 
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Printinn 
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Hoalth  f^siFA  Pinan/*inn  Artminictratinn 
ncaiiii  wciic  I  II lai i^ii  1^  nuiiiii iioii aiiwi i 

Travel 
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$168 

$216 

$541 

"70/ 

/  /o 

Othpr  QPrvippQ 

$22 

$37 

$115 
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2% 

^1  innliPQ 

$25 

I»  14 
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1  o/ 
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vt>00 

1  AO/ 
1  U  /o 

Rental 

$1 

$0 
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$1 
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$0 
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1   1  11  1  III  lU 
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$6 

$24 
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Travel 

4>  1  o 

$81 

$51 

00/ 

/o 

ICl   OCI  VIUCO 

$0 

90 
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U  /o 

AoA  subtotal 

$13 

Sol 

CQ"7 

QO/ 

Operation  Restore  Trust  Total 

Travel 

$483 

$1,402 

$718 

$2,603 

34% 

Other  services 

$158 

$459 

$384 

$1 ,001 

13% 

Hotline 

$156 

$579 

$138 

$873 

11% 

Supplies 

$45 

$681 

$36 

$761 

10% 

Evaluation 

$250 

$450 

$38 

$738 

10% 

Rental 

$104 

$503 

$89 

$696 

9% 

Survey  &  certification 

$23 

$471 

SO 

$494 

6% 

Equipment 

$75 

$26 

$262 

$362 

5% 

Printing 

$2 

$40 

$31 

$72 

1% 

Total 

SI  ,294 

$4,610 

$1,696 

$7,600 

100% 

Source:  Abt  Associates  Inc.,  based  on  data  from  OIG,  HCFA  and  AoA 
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Exhibit  10-3 


Spending  of  the  Operation  Restore  Trust  Budget,  by  Region,  in  Thousands  of  Dollars 


FY  1995 

FY  1996 

FY  1997  Total 

Percent 

Office  of  Inspector  General 

California  $105 

$668 

$172 

$945 

12% 

Florida                                            S1 18 

$601 

$209 

$928 

12% 

Illinois  $75 

$438 

$93 

$606 

8% 

New  York  $36 

$332 

$58 

$426 

6% 

Texas  $83 

$432 

SI  22 

$636 

8% 

ORT  states  $416 

$2,471 

S654 

S3,540 

47% 

Other  states  $15 

$51 

$20 

$85 

1% 

Central  office  $360 

$836 

$362 

$1,558 

21% 

OIG  subtotal  $791 

$3,358 

$1,035 

$5,184 

68% 

Health  Care  Financing  Administration 

California  $5 

$113 

$29 

$146 

2% 

Florida  $55 

$55 

$106 

S216 

3% 

Illinois  $5 

$97 

$10 

$112 

1% 

New  York  $5 

$95 

$5 

S105 

1% 

Texas  $5 

$235 

$11 

$252 

3% 

ORT  states  $75 

$596 

$160 

$831 

11% 

Other  states  $0 

SO 

SO 

$0 

0% 

Central  office  $415 

$575 

$404 

$1,394 

18% 

HCFA  subtotal  $490 

$1,171 

$564 

$2,225 

29% 

Administration  on  Aging 

California  $2 

$25 

$22 

$49 

1% 

Florida  $2 

$11 

$17 

$30 

0% 

Illinois  $1 

$6 

$19 

$26 

0% 

New  York  $1 

$11 

$24 

$36 

0% 

Texas  $4 

$17 

$3 

$24 

0% 

ORT  states  $10 

$70 

$86 

$166 

2% 

Other  states  $0 

$0 

$0 

$0 

0% 

Central  office  $2 

$11 

S11 

$25 

0% 

AoA  subtotal  $13 

$81 

  S97 

$191 

3% 

Operation  Restore  Trust  Total 

California  $112 

$806 

S223 

$1,140 

15% 

Florida  $175 

$667 

S331 

$1,174 

15% 

Illinois  $81 

S541 

3122 

$745 

10% 

New  York  $42 

$438 

S86 

$567 

7% 

Texas  $92 

$684 

S136 

5912 

12% 

ORT  states  $501 

$3,137 

$899 

$4,537 

60% 

Other  states                                       SI 5 

S51 

S20 

$85 

1% 

Central  office  $778 

$1,422 

$777 

$2,977 

39% 

ORT  total  $1,294 

$4,610 

$1,696 

$7,600 

100% 

Notes 

1)  1995  division  by  region  for  OIG  is  an  estimate,  using  the  same  percentage  splits  for  OAS  and 

Ol  as  were  true  in  1996. 

2)  1995  division  by  region  for  HCFA  is  an  estimate. 

It  reflects  the  actual  number  for  central  office. 

an  approximation  for  Florida,  and  the  equal  division  of  the  remaining  $19,989  among  the  other  four  states. 

3)  Central  office  spending  is  a  modest  over-estimate,  since  central  office  paid  for  some  regional  expenses. 

Source:  Abt  Associates  Inc.,  based  on  data  from  OIG,  HCFA  and  AoA. 
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Exhibit  10-4 

ORT  Spending  by  Type  (in  thousands  of  dollars) 

Supplies  $761 


Hotline  $873 
(11%) 
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Exhibit  10-5 

ORT  Budget  by  State  (thousands  of  dollars) 

AoA  $49 


OIG  $636 


TEXAS  $912  (9%) 

HCFA  $252 
AoA  $24 

NEW  YORK  $567  (7%) 


HCFA  $105 
AoA  $36 

ILLINOIS  $745  (10%)  | 

OIG  $606 


HCFA  $146 


rpr-\JCALIFORNIA  $1,140  (15%)| 


HCFA  $112 


OIG  $945 


OIG  $928 


AoA  $26 


Abt  Associates  Inc. 


Appendix  10:  Resources  and  Special  Topics 


10-8 


Medicare's  first  line  of  defense  against  fraud  and  abuse,  and  they  are  responsible  for  detecting 
and  recovering  inappropriate  payments.  Although  the  contractors  were  involved  in  many 
Operation  Restore  Trust  projects,  the  funding  they  received  was  occasional  and  small.  Any 
analysis  of  their  role  during  ORT  must  reflect  this  fact. 

•  ORT  funding  began  slowly.  On  paper,  the  demonstration  started  April  1,  1995.  But  the 
formal  announcement  by  President  Clinton  did  not  occur  until  May  3,  1995,  and  it  was 
August  1995  before  the  regions  received  their  first  disbursements  from  the  ORT  budget.  The 
period  from  April  to  September  1995  accounted  for  one-quarter  of  the  demonstration  period 
but  only  17%  of  ORT  spending. 

•  Travel  was  the  single  largest  expense.  Travel  costs  for  federal  employees  were  $2.6  million, 
or  one-third  of  the  budget.  Moreover,  another  SO. 5  million  was  paid  to  state  survey  and 
certification  agencies,  and  most  of  that  amount  covered  travel  by  state  employees  on  ORT 
work.  Again  and  again  we  heard  from  regional  officials  how  important  the  travel  money  was 
to  ORT  projects.  Federal  agencies  often  labor  under  tight  travel  budgets,  which  become 
increasingly  restricted  as  the  fiscal  year  progresses.  The  savings  are  often  a  chimera,  since 
the  inability  to  travel  means  that  auditors  and  investigators  cannot  work  where  they  are 
needed  most.  The  dichotomy  is  most  evident  in  Florida,  since  most  OIG  auditors  are  based 
in  the  regional  office  in  Atlanta  while  fraud  and  abuse  appears  to  be  rampant  in  the  Miami 
area.  For  officials  responsible  for  Florida  and  the  other  ORT  states,  ORT  meant  that  these 
limitations  all  but  disappeared. 

•  The  hotline  and  this  evaluation  were  the  next  most  expensive  items.  The  expanded  OIG 
hotline  was  the  next  most  expensive  cost,  accounting  for  $0.6  million  in  payments  to  the 
hotline  contractor  (Raymond  Maria  Group  Ltd.)  and  at  least  another  $250,000  for  telephone 
and  related  costs.  The  cost  of  this  evaluation  was  $0.7  million.  Both  these  items  appear 
under  central  office  spending  in  Exhibit  10-3. 

•  The  ORT  budget  appeared  to  be  very  useful  in  facilitating  ORT  activities.  In  many 
instances  we  were  struck  by  the  ability  of  modest  additional  funding  to  lever  additional 
commitments  of  resources.  For  example,  ORT  funds  were  used  to  pay  the  travel  costs  of  state 
survey  and  certification  officials  who  worked  on  ORT  reviews  of  nursing  homes  and  home 
health  agencies.  These  funds  were  modest  yet  resulted  in  the  state  agencies  being  willing  to 
have  their  staff  members  work  on  federal  projects.  In  Florida,  to  take  another  example, 
investigators  working  on  the  St.  John'h  Home  Health  Agency  investigation  used  ORT  funds 
to  rent  a  warehouse  for  data,  buy  the  computer  hardware  to  analyze  it,  and  hire  a  former 
employee  of  the  HHA  to  help  interpret  it.  "There  is  no  way  we  could  have  done  the  St. 
John's  investigation  without  ORT,  period,"  a  senior  01  official  told  us. 

•  Florida  and  California  received  the  most  funding.  $4.5  million  was  spent  by  the  ORT 
regions.  Among  the  regions,  Florida  had  the  largest  budget  ($1.2  million),  followed  by 
Cahfomia($l.l  million),  Texas  ($0.9  million).  Illinois  ($0.7  million),  and  New  York  ($0.6 
million). 
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10.1.3  Increased  Funding  for  OIG  Personnel 


Although  the  ORT  budget  did  not  include  personnel  costs,  there  was  an  increase  in  OIG  staffing  that  was 
directly  attributable  to  the  demonstration.  In  the  spring  and  summer  of  1995,  OIG  hired  29  additional  staff 
who  worked  almost  exclusively  on  ORT  projects.  Of  the  29,  24  were  01  agents,  two  were  OAS  staff  and 
three  were  OEI  staff.  The  cost  of  these  additional  staff  was  borne  by  HCFA  in  FY  1996,  which  transferred 
$1.6  million  from  its  general  funds  to  OIG  to  cover  their  salaries  and  fringe  benefits  in  FY  1996.  In  FY 

1995  and  FY  1997,  OIG  paid  the  salaries  and  benefits  from  its  own  appropriation.  We  estimate  the  total 
cost  of  these  additional  resources  to  be  at  least  S3.0  million  over  the  two  years  of  the  demonstration  and 
probably  more,  once  associated  increases  in  overhead  cost  are  factored  in. 

Exhibit  10-6  shows  total  OIG  staffing  as  of  April  1995  (the  first  month  of  the  demonstration)  and  October 

1996  (three-quarters  way  through  the  demonstration).  OIG  staffing  in  the  ORT  states  increased  from  268 
to  296.  More  investigators  accounted  for  virtually  all  of  the  increase,  which  was  spread  fairly  evenly 
across  the  five  states.  (See  Exhibit  10-7.)  Staffing  counts  at  any  point  in  time  also  reflect  normal  turnover, 
so  the  increases  do  not  correspond  precisely  to  the  additional  staff).  At  the  same  time  as  OIG  staffing  in 
the  ORT  states  was  increasing,  however,  it  was  falling  in  other  states,  so  nationwide  OIG  staffing  was 
essentially  unchanged  (925  in  October  1996  compared  with  923  in  April  1995).- 

It  appears  that  the  additional  personnel  in  the  ORT  states  played  a  key  role  in  the  success  of  the 
demonstration.  Many  ORT  activities — the  hotline,  referrals  from  ombudsmen,  increased  data  analysis  by 
HCFA,  heightened  review  of  home  health  agencies  and  nursing  homes — were  designed  to  generate 
referrals  to  the  Office  of  Investigations.  But  as  one  01  official  told  us,  "it  wasn't  as  if  we  had  nothing  to 
do  before  ORT."  Operation  Restore  Trust  would  have  been  a  failure  if  the  higher  number  of  referrals  to 
01  had  hit  a  bottleneck  and  caused  frustration  among  ORT  participants  that  undermined  the  demonstration. 
To  be  sure,  there  was  frustration  that  more  results  were  not  forthcoming.  But  the  additional  staff  meant 
that  delays  were  almost  certainly  shorter  than  they  otherwise  would  have  been.  The  level  of  frustration 
did  not  appear  to  be  a  fatal  problem  in  the  demonstration — which  could  have  been  the  case. 

10.1.4  A  Sense  of  Priority 

The  concept  may  be  imprecise,  but  there  is  no  doubt  that  one  of  the  "resources'"  expended  on  Operation 
Restore  Trust  was  high-level  effort  throughout  the  government  to  create  a  clear  sense  that  the 
demonstration  was  important.  President  Clinton  announced  Operation  Restore  Trust  at  the  White  House 
Conference  on  Aging  in  May  1995,  and  it  was  repeatedly  described  publicly  as  a  Department  priority  by 
the  Secretary,  Donna  Shalala,  the  HCFA  Administrator,  Bruce  Vladeck,  and  the  Inspector  General,  June 
Gibbs  Brown.  Other  senior  officials  in  OIG,  HCFA  and  AoA  spent  countless  hours  reinforcing  this 
message. 


Total  OIG  sialTing  rose  to  1,063  by  the  end  of  the  demonstration  (March  1997).  hut  the  increase  was  not  pan  of  Operation  Restore 
Trust.  Thirty-nine  personnel  were  transferred  from  the  HHS  Office  of  the  General  Counsel  to  tbrm  a  new  Office  of  Counsel  to  the 
Inspector  General.  Most  of  the  remaining  increase  reflected  increases  in  staffing  following  the  enactment  of  the  Health  Insurance 
Ponabiliiy  and  Accountability  Act  of  1996  (i.e..  the  '  Kassebaum-Kennedy  bill"). 
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Exhibit  10-6 

OIG  Personnel  Assigned  to  ORT  and  non-ORT  states 


A.  AS  OF  APRIL  1995 


Audit 
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Vo  of 
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Invest 
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Total 

total 
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22 

10 
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41 
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19 

2% 

2 
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1 0 
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21 
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g 
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0 
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0% 
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49 

25 

9 

0 

83 

9% 

18 

Jacksonville 

g 

0 

0 

0 

g 

1% 

0 

Tallahasee 

Q 

Q 

Q 

7 

1% 

0 

Miami 

3 

3 

0 

0 

g 

1% 

3 

Clearwater 

0 

2 

Q 
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2 

0% 

2 

Orlando 

0 

5 

Q 

0 

5 

1% 

3 

Florida  subtotal 

16 

10 

Q 

Q 

26 

3% 

s 

ChicaQO 

1 0 

14 

1 0 

0 

34 

4% 

10 

Springfield 

12 

0 

0 

0 

12 

1% 

0 

Fairview  Heights 

0 

0 

0 

0 

0 

0% 

0 

Illinois  subtotal 

22 

14 

10 

0 

46 

5% 

10 

New  York 

27 
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g 

0 

47 

5% 

9 

Albany 
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2% 
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New  York  subtotal 
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Q 
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Dallas 

19 
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36 

4% 

5 

Houston 

0 

0 

0 

0 

0 

0% 

0 

San  Antonio 

0 

2 

0 

0 

2 

0% 

2 

Texas  subtotal 

29 

12 

7 

0 

48 

5% 

7 

ORT STATES 

157 

79 

32 

0 

268 

29% 

56 

NON-ORT  STATES 

402 

138 

62 

53 

655 

71% 

103 

OIG  TOTAL 

559 

217 

94 

53 

923 

100% 

159 

B.  AS  OF  OCTOBER  1996 

Audit 

Eval  & 

%  of 

Crim 
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Invest. 
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Other 

Total 

total 

invest 

Operation  Restore 

Trust  States 

San  Francisco 

21 

10 

g 

0 

40 

4% 

6 

Sacramento 

17 

4 

0 

0 

21 

2% 

4 
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9 

14 

0 

0 

23 

2% 

12 
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0 

3 

0 

0 
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0% 

3 
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0% 

1 
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24 

18 

8 

0 

SO 

5% 

13 
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27 

18 

6 

0 

51 

6% 

13 

Albany 

14 

2 

0 

0 

16 

2% 

2 

Buffalo 

0 

2 

0 

0 

2 

0% 

2 

New  York  subtotal 

41 

22 

6 

0 

69 

7% 

17 

Austin 

10 

0 
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0 

10 

1% 

0 

Dallas 

19 

1 1 

9 

0 

39 

4% 

7 

Houston 

0 

5 

0 

0 

5 

1% 

4 
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0 

2 

0 

0 

2 

0% 

2 

Texas  subtotal 

29 

18 

9 

0 

56 

6% 

13 

ORT STATES 
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106 

32 

0 

296 

32% 

83 

NON-ORT  STATES 

376 

121 

59 

73 

629 

68% 

83 

OIG  TOTAL 

534 

227 

91 

73 

925 

100% 
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Source  Abt  Associates  Inc  based  on  data  from  Off^^ce  of  Inspector  General 
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Exhibit  10-7:  OAS  and  01  Personnel  by  ORT  State,  1995  and  1996 
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As  a  result,  many  initiatives  that  took  time  and  encountered  opposition  took  less  time  and  encountered  less 
opposition  than  otherwise  would  have  been  the  case.  Since  not  everything  can  be  a  priority,  the 
designation  of  Operation  Restore  Trust  as  such  clearly  represented  the  use  of  a  scarce  resource  within  the 
Department  of  Health  and  Human  Services.  Just  how  scarce  may  be  seen  after  ORT,  when  the  ORT 
partners  face  renewed  challenges  from  other  matters  for  their  time. 

10.1.5  Efforts  of  Other  Health  and  Human  Services  Personnel 

The  single  largest  resource  devoted  to  Operation  Restore  Trust  was  the  effort  of  existing  OIG,  HCFA  and 
AoA  personnel.  As  Exhibit  10-6  shows,  the  OIG  had  268  personnel  in  the  five  ORT  states  at  the 
beginning  of  the  demonstration.  Although  they  had  responsibilities  besides  ORT  projects — such  as  other 
types  of  health  care  fraud  and  abuse,  audits  of  state  agencies,  and  investigations  of  wrongdoing  by  HHS 
employees — it  is  clear  that  Operation  Restore  Trust  projects  became  the  principal  activity  of  many  of  them. 
Similarly,  many  individual  HCFA  staff  members,  especially  in  the  regional  Divisions  of  Medicare  and 
Health  Standards  and  Quality,  each  worked  hundreds  of  hours  on  ORT  activities.  The  effort  put  in  by  staff 
of  the  Administration  on  Aging,  which  is  a  much  smaller  agency  than  OIG  or  HCFA,  probably  amounted 
to  the  equivalent  of  several  person-years  as  well. 

A  rough  estimate  of  these  contributions  is  possible  only  for  staff  from  the  Office  of  Audit  Services,  who 
keep  timesheets.  (The  Office  of  Evaluation  and  Inspections  also  began  keeping  timesheets  part-way 
through  the  demonstration.)  As  discussed  in  Appendix  5,  OAS  staff  in  the  ORT  states  spent  1 8,920  days 
on  ORT  projects  during  the  two-year  demonstration.  In  rough  terms,  ORT  projects  appear  to  have 
required  about  one-quarter  to  one-half  of  all  time  put  in  by  audit  personnel  who  worked  on  ORT  projects.^ 
This  level  of  effort  can  be  translated  into  dollars  using  an  annual  cost  per  person  of  about  $60,000,  which 
would  represent  a  conservative  figure  for  salary  and  fringe  benefits  for  approximately  230  work  days  per 
year  after  holidays,  vacation,  sick  time  and  training.^  The  result  is  $4.9  million.  OAS  staff  in  non-ORT 
states  charged  another  2,766  days  to  ORT  auditee-type  audits,  which  would  bring  the  total  to  $5.7  million. 
Although  the  efforts  of  01,  OEI,  HCFA  and  AoA  personnel  cannot  be  quantified  to  the  same  degree,  it 
is  clear  that  their  efforts  would  easily  amount  to  several  million  additional  dollars. 

Only  general  comments  can  be  made  about  the  proportion  of  this  effort  that  would  have  been  made 
regardless  of  ORT  and  the  proportion  that  represented  an  increase  in  resources  devoted  to  health  care  fraud 
and  abuse.  If  Operation  Restore  Trust  had  not  occurred,  almost  all  of  the  work  done  by  OIG  staff  probably 
would  have  involved  Medicare  fraud  anyway.  The  investigators,  auditors  and  evaluators  of  OIG  also  work 
on  investigations,  audits  and  studies  involving  the  Public  Health  Service,  claims  from  states  for  Medicaid 
funding  and  other  areas  of  Health  and  Human  Services  responsibility.  While  this  other  work  was  put  aside 
for  ORT  to  some  extent,  the  magnitude  of  the  Medicare  fraud  problem  is  such  that  it  tends  to  have  first 
claim  on  OIG  resources  in  any  circumstances. 


3  If  the  average  number  of  OAS  personnel  in  the  ORT  states  was  1 55  and  the  average  number  of  working  days  per  year  was  230  (i.e.. 
after  holidays,  vacation  and  sick  time),  the  percentage  would  be  about  half  But  auditors  from  Atlanta  and  other  cities  outside  the  ORT 
slates  also  worked  in  the  ORT  stales,  so  the  figure  of  155  personnel  understates  the  number  who  worked  on  ihese  audits. 

4  A  rough  check  on  this  figure  can  be  made  by  noting  that  in  FY  1996  the  Office  of  Audit  Services  charged  other  agencies  a  flat  rate  of 
S58.5 1  an  hour  There  are  2,080  hours  or  260  days  in  the  work-year;  if  holidays,  vacation,  sick  lime  and  training  accounted  for  30  days 
or  240  hours,  then  S58.51  *  1,840  =  3107,658.  The  figure  of  560,000  a  year  is  therefore  conser\ative. 
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In  HCFA,  the  regional  Divisions  of  Medicare  have  traditionally  worked  on  Medicare  fraud  as  particular 
problems  arise.  Under  Operation  Restore  Trust,  these  divisions  took  more  initiative  and  increased  the  time 
they  spent  on  these  problems.  The  same  statement  applies  to  the  regional  Divisions  of  Medicaid  but  to 
a  lesser  extent.  For  the  regional  Divisions  of  Health  Standards  and  Quality,  involvement  in  health  care 
fraud  projects  was  new,  and  almost  all  the  time  put  in  by  DHSQ  staff  on  ORT  represented  an  increase  in 
resources.  The  same  is  true  of  Administration  on  Aging  staff. 

10.1.6  Efforts  of  Personnel  Outside  Health  and  Human  Services 

Many  of  the  outcomes  of  Operation  Restore  Trust  are  attributable  at  least  in  part  to  activities  of  people 
outside  the  Department  of  Health  and  Human  Services.  It  would  be  impossible  to  quantify  these  efforts, 
but  the  following  list  is  in  approximately  declining  order  of  magnitude. 

•  Medicare  contractors  were  responsible  for  actually  recovering  funds  identified  as  potential 
overpayments  through  the  audits  and  expanded  surveys.  Contractors  were  also  responsible 
for  pursuing  most  of  the  leads  generated  by  the  hotline  that  resulted  in  the  recovery  of 
overpayments.  They  also  provided  assistance  on  an  ad  hoc  basis,  for  example  by  doing 
computer  runs  for  various  ORT  projects.  These  efforts  were  valuable  to  Operation  Restore 
Trust  but  in  almost  all  cases  they  probably  would  have  been  expended  on  controlling  health 
care  fraud  even  if  ORT  had  not  occurred. 

•  U.S.  Attorney's  Offices  handled  criminal  prosecutions  and  civil  suits  involving  Medicare 
fraud  and  abuse.  Particularly  in  Florida,  they  were  also  responsible  for  obtaining  temporary 
restraining  orders  that  protected  disputed  funds  from  disappearing  before  they  could  be 
recovered.  Their  effort  was  substantial  and  represented  an  increase  compared  with  the  pre- 
ORT  period.  The  increase,  however,  was  not  directly  linked  to  Operation  Restore  Trust  (see 
Appendix  4). 

•  State  agencies  on  aging  helped  organize  the  aging  network  training  sessions  that  were 
sponsored  by  Operation  Restore  Trust  in  each  ORT  state.  This  involvement  was  new  and  was 
due  to  Operation  Restore  Trust. 

•  State  survey  agencies  worked  with  HCFA  and  OAS  staff  on  the  surveys  of  home  health 
agencies  and  skilled  nursing  facilities.  Although  surveys  of  these  facilities  are  the  principal 
activity  of  these  state  agencies,  the  focus  on  fraud  and  financial  abuse  was  new  and 
attributable  to  Operation  Restore  Trust. 

•  Medicaid  programs  contributed  their  time  and  that  of  their  fiscal  agents  (i.e.,  claims-paying 
contractors)  to  joint  initiatives  with  the  federal  government.  Although  Medicaid  programs 
were  not  involved  in  ORT  to  the  extent  originally  envisioned,  their  contribution  was 
particularly  notable  in  New  York,  Texas,  and  Florida.  Whether  these  efforts  represented  an 
increase  in  effort  on  health  care  fraud  depended  on  the  state,  but  they  certainly  represented 
increased  resources  devoted  to  cooperative  projects  with  the  federal  government. 

•  Other  law  enforcement  agencies,  especially  the  Federal  Bureau  of  Investigation,  cooperated 
with  the  Office  of  Investigations  and  other  ORT  agencies  in  pursuing  cases.  Although  the 
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contribution  of  the  FBI  to  controlling  health  care  fraud  and  abuse  is  large  and  increasing,  in 
most  instances  FBI  cases  were  not  counted  as  part  of  Operation  Restore  Trust. 

10.2  Fraud  and  Abuse  Hotline 

10.2.1  Overview 

The  fraud  and  abuse  hotline,  in  place  since  1 979,  was  substantially  expanded  under  Operation  Restore 
Trust.  It  also  ranks  with  travel  cost  as  the  largest  ORT  expenditure,  with  cost  over  the  two-year 
demonstration  of  $0.9  million,  or  about  1 1  %  of  the  ORT  budget.  In  uie  latter  months  of  Operation  Restore 
Trust,  the  hotline  was  handling  about  1 ,500  phone  calls  and  letters  a  month,  though  only  about  500  were 
complaints  alleging  fraud  or  abuse  and  only  60  of  those  involved  the  ORT  focus  areas  in  the  ORT  states. 
The  hotline  appears  to  have  been  successful  in  generating  over  $6  million  in  administrative  recoveries 
from  providers,  but  its  impact  on  investigative  actions  and  other  aspects  of  fraud  control  has  been  limited. 
Though  more  effective  than  it  was  before  Operation  Restore  Trust,  the  hotline  so  far  has  not  been  the 
powerful  investigative  tool  that  some  ORT  proponents  had  envisioned. 

10.2.2  Hotline  Organization 

The  Office  of  Inspector  General  started  its  hotline  in  1 979.  Virtually  no  records  have  been  kept  about  its 
organization,  activity  levels  and  impact  from  1979  to  1989.  Starting  in  1989,  basic  information  on  the 
complainant's  name,  telephone  number  and  complaint  were  entered  into  a  database,  but  no  effort  was 
made  by  the  hotline  unit  to  keep  track  of  how  complaints  were  handled. 

One  of  the  first  changes  to  the  federal  government's  fraud  and  abuse  control  activities  under  Operation 
Restore  Trust  was  the  expansion  of  the  hotline  effort.  A  new  national  hotline  number  ( 1  -800-HHS-TIPS 
or  1  -800-447-8477)  was  introduced  to  replace  1  -800-368-5779,  which  had  been  in  place  for  years.  Hotline 
management  was  also  transferred  in  June  1995  from  OIG  staff  to  an  outside  contractor,  Raymond  Maria 
Group  Ltd.,  which  is  a  law  enforcement  consulting  firm.  The  physical  location  was  moved  from 
Baltimore  to  a  modest  suite  of  offices  at  OIG  headquarters  in  Washington,  D.C.  Raymond  Maria  Group 
has  the  equivalent  of  10.5  staff  assigned  to  the  hotline:  six  operators,  two  data  analysts,  1 .5  supervisory 
staff  and  one  administrative  staff  member.  A  monthly  report  describes  the  number  of  items  handled  and 
their  disposition.  The  two  year  budget  of  $623,000  to  the  contractor  covers  the  cost  of  personnel.  In  FY 
1996,  telephone  costs  amount  to  another  $255,500;  these  costs  were  not  separately  billed  to  Operation 
Restore  Trust  in  FY  1995  or  FY  1997.  Other,  relatively  minor,  hotline  costs  such  as  supplies  were  paid 
either  from  ORT  funds  or  general  OIG  funds  without  being  separately  identified. 

The  hotline  was  not  actively  advertised.  It  was  often  included  in  descriptions  of  Operation  Restore  Trust, 
and  federal  officials  regularly  mentioned  the  easily  remembered  1  -800-HHS-TIPS  number.  (When  an  OIG 
official  gave  the  number  on  NBC's  newsmagazine  program  "Dateline,"  calls  to  the  hotline  surged  for 
several  days.)  The  number  also  appeared  on  Operation  Restore  Trust  brochures  and  posters — although 
it  is  also  significant  how  many  times  it  did  not  appear.  Three  posters  produced  by  the  Florida  State 
Ombudsman  gave  three  separate  hotline  numbers  to  call,  for  example:  800-HHS-TIPS,  800-333-7586  (the 
Ombudsman's  hotline)  and  800-892-0375  (the  Medicaid  fraud  hotline  for  Florida).  Medicare  carriers  and 
intermediaries  also  operate  hotlines,  so  beneficiaries  have  many  choices  when  they  seek  to  report  health 
care  fraud. 
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According  to  hotline  staff,  30%  to  40%  of  hotline  callers  say  they  obtained  the  number  through  the 
telephone  book  or  directory  assistance.  Until  April  1997,  however,  even  the  Washington,  D.C.,  telephone 
book  showed  the  previous  hotline  number  rather  than  1-800-HHS -TIPS.  A  recording  advised  callers  to 
call  two  other  numbers  about  Social  Security  fraud  or  to  call  1-800-HHS-TIPS  about  fraud  "in  any 
program  administered  by  the  Department  of  Health  and  Human  Services."  (Medicare  and  Medicaid  were 
not  mentioned  by  name.)  Although  the  recording  offered  to  transfer  the  caller  to  an  operator,  the 
connection  was  not  made  and  the  caller  cycled  back  to  the  recording.  OIG  officials  knew  about  this 
endless  loop  but  did  not  change  the  recording.  When  the  HHS  operator  was  called  directly,  the  caller  was 
advised  to  call  800-HHS-TIPS. 

The  federal  government  is  in  the  midst  of  a  two-year  process  to  make  its  "blue  page"  listings  in  telephone 
books  more  user  friendly.  During  this  process,  hotline  staff  said  it  was  "hit  or  miss"  whether  the  correct 
hotline  number  appeared  in  the  phone  book.  In  phone  books  where  the  change  has  been  made  (e.g., 
Washington  as  of  May  1997)  the  800-HHS-TIPS  number  is  listed  under  "Inspector  General's  Fraud 
Hotline"  and  under  "Medicare  Fraud  and  Abuse." 

Callers  to  the  hotline  were  asked  to  go  through  a  phone  tree  that  sorted  calls  by  program  (Medicare, 
Medicaid,  Social  Security,  etc.),  by  nature  (fraud  complaint,  request  for  information,  etc.)  and  by  whether 
it  involved  home  health  care,  hospice  care  or  skilled  nursing  services  in  one  of  the  five  ORT  states.  Calls 
about  Social  Security  or  calls  requesting  simple  information  were  answered  by  a  recording  that  listed  the 
appropriate  telephone  number,  then  hung  up.  Calls  about  health  care  fraud  and  abuse  were  handled  by 
one  of  six  operators.  "We  don't  take  complaints — we  interview  callers,"  the  hotline  manager  told  us,  to 
emphasize  the  effort  that  operators  place  on  obtaining  as  much  useful  information  as  possible,  including 
claims  forms  and  other  documentation. 

When  a  caller  made  a  complaint,  the  operator  typed  the  information  on  a  computer  screen  and  created  an 
electronic  record  that  went  into  a  database  tracking  system.  The  caller  was  given  a  complaint  number,  told 
it  takes  six  to  12  months  to  resolve  a  case  and  advised  to  go  through  the  Department's  Freedom  of 
Information  Act  office  to  obtain  an  update  on  the  case.  The  complaint  was  reviewed  for  completeness  by 
a  data  analyst,  usually  the  next  day. 

Complaints  involving  Medicare  or  Medicaid  were  transferred  electronically  about  once  a  week;  complaints 
about  the  Public  Health  Service  and  other  programs  were  forwarded  on  paper.  Complaints  involving  ORT 
focus  areas  were  sent  directly  to  the  ORT  coordinator  in  California,  to  HCFA  Division  of  Medicare 
beneficiary  services  staff  in  New  York  and  Illinois,  and  to  HCFA  contractors  in  Florida  and  Texas.  Copies 
were  sent  to  the  regional  inspector  general  for  investigations  and  to  the  HCFA  central  office.  Complaints 
that  called  for  immediate  action  were  handled  as  exceptions,  with  the  appropriate  officials  contacted 
immediately.  So  long  as  a  complainant  was  coherent,  the  hotline  contractor  forwarded  all  complaints  to 
the  regions  or  to  HCFA  Central  Office.  Six  months  after  the  original  complaint,  the  responsible  agency 
was  supposed  to  report  back  to  the  hotline  staff  about  the  status  of  the  complaint  so  that  records  could  be 
maintained  on  outcomes  from  hotline  calls.  In  practice,  however,  hotline  staff  said  they  were  "pretty 
lenient"  so  long  as  the  region  kept  resolving  complaints  at  a  reasonable  pace. 
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10.2.3  Hotline  Activity 


From  June  1 995  to  March  1 997,  the  hothne  received  46,936  calls  and  letters,  an  average  of  70  per  day. 
Less  than  a  third — 29% — were  actual  complaints  about  programs  within  the  purview  of  DHHS.  These 
13,797  calls  and  letters  were  entered  into  the  database  of  hotline  complaints.  Another  36%  of  the  calls  and 
letters  were  requests  for  information,  while  1 1  %  were  referred  to  other  organizations,  1 1  %  involved  the 
Social  Security  program  and  4%  were  irrelevant,  incoherent  or  otherwise  miscellaneous.  (See  Exhibit  10- 
8.) 

Of  the  13,797  complaints,  63%;  involved  the  Medicare  Part  B  program,  22%  the  Medicare  Part  A  program, 
9%  the  Medicaid  program  and  7%  the  Public  Health  Service,  other  health  programs  or  Departmental  staff. 
Note  that  Part  B  complaints  were  three  times  as  numerous  as  Part  A  complaints.  Although  Medicare 
spends  only  half  as  much  on  Part  B  as  it  does  on  Part  A,  there  are  five  times  as  many  Part  B  claims  as  there 
Part  A  claims,  since  Part  A  claims  tend  to  be  for  more  expensive  services.  Part  A  benefits  include 
inpatient  hospital  care,  skilled  nursing  facility  care,  almost  all  home  health  care,  and  hospice  care.  Part 
B  benefits  include  physician  services,  outpatient  hospital  care,  durable  medical  equipment,  and  laboratory 
services. 

The  low  volume  of  Medicaid  complaints  was  also  notable:  Medicaid  complaints  equaled  one-tenth  of 
Medicare  complaints,  although  the  sum  of  federal  and  state  spending  on  Medicaid  now  equals  83%  of 
Medicare  spending.  Although  the  hotline  number  applies  to  both  the  Medicare  and  Medicaid  programs, 
the  states  operate  Medicaid  and  therefore  the  public  may  direct  their  complaints  to  the  states. 

The  hotline  number  is  made  available  across  the  U.S.  and  calls  are  received  from  all  states.  During 
Operation  Restore  Trust,  61  %  of  the  complaints  came  from  the  five  ORT  states,  which  together  account 
for  one-third  of  Medicare  beneficiaries.  The  difference  may  reflect  more  awareness  of  the  hotline  in  the 
ORT  states,  more  fraud  and  abuse  waiting  to  be  reported,  or  (perhaps  most  likely)  the  fact  that  the  hotline 
telephone  tree  connects  callers  from  ORT  states  to  a  live  operator  sooner  than  it  does  callers  from  other 
states. 

Of  the  8,381  complaints  from  the  ORT  states,  however,  just  1,507,  or  18%,  involved  the  ORT  focus  areas 
of  durable  medical  equipment,  home  health  and  nursing  home  services.  Hospice  services — which  were 
elsewhere  considered  within  the  scope  of  ORT — were  not  reported  as  ORT  complaints  by  the  hotline. 

It  is  therefore  important  to  keep  in  mind  that  only  about  3%  of  calls  and  letters  hotline  were  complaints 
within  the  scope  of  Operation  Restore  Trust.  This  is  not  a  criticism,  since  hotlines  inevitably  attract 
requests  for  program  information  as  well  as  calls  that  would  be  more  appropriately  handled  elsewhere. 
Even  when  we  look  at  complaints  only,  it  is  hardly  a  failing  of  the  hotline  that  the  public  complains  about 
fraud  and  abuse  outside  the  ORT  states  and  the  ORT  focus  areas.  But  it  does  mean  that  Operation  Restore 
Trust  is  a  small  part  of  the  hotline  picture.  (See  Exhibit  10-9.) 
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Exhibit  10-8 

Calls  and  Letters  to  Fraud  and  Abuse  Hotline 


ORT  Focus-Area  Complaints 
1,507 
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Exhibit  10-9 


Hotline  Complaints  by  ORT  State  and  ORT  Focus  Area,  June  1995-March  1997 

State 

California 

Florida 

Illinois 

New  York 

Texas 

Total 

ORT  Focus  Areas 

Durable  Medical 
Equipment 

94 

237 

51 

72 

73 

527 

Home  Health  Care 

153 

126 

53 

51 

ii4j 

Nursing  Home 
Services 

41 

82 

103 

47 

81 

354 

Subtotal 

288 

445 

207 

170 

397 

1,507 

Non-ORT  Topics 

920 

2,066 

464 

2.341 

1,083 

6,874 

Total  ORT  States 

1,208 

2,511 

671 

2,511 

1,480 

8,381 

A    Hospice  services  were  not  defined  as  an  Operation  Restore  Trust  focus  area  for  purposes  of  the  hotline. 

Source:  Abt  Associates  Inc.,  based  on  Office  of  Inspector  General,  Fraud  Fighters:  The  HHS  Fraud  Hotline, 
monthly  reports,  June  1995-March  1997.  ^^^^^ 
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Many  factors  can  be  hypothesized  to  have  an  effect  on  the  level  of  hotline  activity.  These  influences — or 
in  some  cases,  lack  of  influence — including  the  following.  (See  Exhibit  10-10.) 

•  Disconnecting  the  previous  number.  Until  June  19,  1996,  calls  made  to  the  old  hotline  number 
were  still  answered  by  hotline  staff.  When  that  ended,  hotline  volume  fell  sharply,  as  shown  in 
Exhibit  10-10.  Total  volume  fell  60%  from  an  average  of  3,198  items  a  month  in  the  March-May 
period  to  1,272  in  the  July-September  period.  The  volume  of  complaints  fell  by  only  26%,  from 
an  average  of  703  a  month  to  an  average  of  518.  in  part  because  the  slowdown  in  telephone  calls 
allowed  hotline  staff  to  catch  up  with  a  backlog  of  complaint  letters. 

•  Reorganization  of  Social  Security.  After  March  1996  and  the  reorganization  of  the  Social 
Security  Administration  into  a  agency  outside  DHHS,  the  hotline  was  no  longer  responsible  for 
Social  Security  complaints,  which  were  referred  to  a  separate  hotline.  Total  volume  declined  in 
April  and  May,  but  the  real  impetus  for  the  decline  appears  to  be  have  been  the  disconnection  of 
the  old  hotline  number  in  June  1996. 

•  Publicity  on  EOMBs.  In  the  spring  of  1996,  beneficiaries  in  New  York  began  seeing  the  1-800- 
HHS-TIPS  number  on  their  Explanation  of  Medicare  Benefits  (BOMB).  This  change  appears  to 
explain  the  hump-like  increase  in  New  York  complaints  (Exhibit  10-11).  Most  of  these  calls  did 
not  refer  to  ORT  focus  areas,  but  the  increase  was  significant. 

Special  fraud  alerts.  The  publication  of  special  fraud  alerts  might  be  expected  to  result  in  more 
hotline  items,  but  it  is  unclear  that  this  occurred.  (See  also  Section  10-4.)  The  first  special  alert, 
on  home  health  fraud,  was  published  in  June  1995  but  at  that  time  the  hotline  staff  did  not 
compile  statistics  by  focus  area.  A  second  special  fraud  alert,  on  nursing  home  care,  was 
published  in  August  1995,  and  the  volume  of  complaints  did  rise  in  the  ORT  states.  But  the 
fourth  special  alert,  also  on  nursing  home  services,  coincided  with  a  decrease  in  nursing  home 
complaints  when  it  was  published  in  May  1996.  (The  third  special  alert  was  on  hospice  care,  but 
the  effect  on  complaints  can't  be  discerned  because  the  hotline  unit  did  not  compile  data  on 
hospice  calls  specifically.)  In  other  words,  any  link  between  special  fraud  alerts  and  hotline 
volume  is  uneven,  at  best. 

1 0.2.4  Impact  of  the  Hotline 

During  Operation  Restore  Trust,  the  hotline  registered  a  total  13,794  complaints.  By  March  31,  1997,  566 
had  been  resolved  with  monetary  recoveries,  2,980  had  been  resolved  without  a  monetary  recovery,  and 
10.248  had  not  yet  been  resolved.  According  to  hotline  staff,  total  recoveries  were  $6.1  million,  or  an 
average  of  $10,777  per  resolved  complaint.  Essentially  all  of  this  sum  represented  recoveries  made 
administratively  by  Medicare  carriers  and  intermediaries.  That  is,  the  hotline  was  reasonably  effective  in 
triggering  contractor  recoupment  actions.  Such  recoveries  occur  when  a  carrier  or  intermediary  challenges 
claims  submitted  by  a  provider  and  the  provider  agrees  to  pay  back  the  amount  in  question.  Carriers  and 
intermediaries  confirm  these  recoveries  in  letters  sent  to  the  hotline. 
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Exhibit  10-10 

Hotline  Calls  and  Letters  by  Month 
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Exhibit  10-11 

ORT  and  Non-ORT  Focus  Area  Complaints  by  State 
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The  usefulness  of  the  hotline  as  an  investigative  tool — i.e.,  supporting  the  work  of  the  Office  of 
Investigations — is  less  clear.  In  our  interviews  with  investigators,  auditors  and  Medicare  officials  at  the 
regional  level,  we  usually  heard  the  opinion  that  the  hotline  generated  paperwork  but  not  fresh  and  useful 
information.  According  to  our  analysis  of  the  OIG  Case  Information  Management  System  (CIMS  i,  the 
hotline  was  the  source  of  just  13  01  cases  over  the  two  years  of  Operation  Restore  Trust,  for  example,  and 
none  of  these  cases  had  resulted  in  savings,  sanctions,  a  criminal  prosecution  or  a  civil  lawsuit.  It  is  true 
that  the  hotline  resulted  in  just  two  01  cases  in  the  two  years  before  ORT.  and  that  during  ORT  only  two 
cases  in  the  ORT  comparison  states  can  be  linked  to  the  hotline.  But  given  the  very  low  numbers,  it  is  fair 
to  say  that  the  role  of  the  hotline  in  Operation  Restore  Trust  has  been  less  than  expected  and  that  it  has 
frustrated  officials  on  the  front  lines  of  the  battle  against  fraud  and  abuse.  Several  factors  appear  to 
explain  this  result: 

•  All  complaints  are  forwarded  regardless  of  merit.  Although  the  hotline  staff  disregarded  calls 
and  letters  that  were  obviously  incoherent,  they  otherwise  had  no  choice  but  to  forward  all 
complaints  either  directly  to  HCFA  central  office  or  directly  to  the  ORT  states.  Complaints 
received  by  HCFA  central  office  were  handled  by  the  Management,  Analysis  and  Planning  staff 
rather  than  the  Benefits  Integrity  Office,  and  that  office  also  forwarded  essentially  all  complaints. 

Yet  complaints  varied  widely  in  their  usefulness.  Much  effort  appears  to  have  gone  into  tracking 
the  progress  of  complaints  that  probably  had  little  value  in  reducing  fraud  and  abuse.  It  appears 
that  exercising  more  discretion  earlier  in  the  complaint-handling  process  would  have  reduced  the 
amount  of  work  on  the  complaints  without  noticeably  reducing  their  overall  usefulness.  Whether 
this  discretion  should  be  exercised  by  the  hotline.  HCFA  central  office,  or  the  receiving  official 
at  the  regional  level  is  unclear. 

•  Hotline  leads  are  unlikely  to  uncover  some  prevalent  forms  of  fraud  and  abuse.  Medicaid  and. 
especially.  Medicare  are  complicated  programs  that  many  beneficiaries  cannot  be  expected  to 
understand.  For  example,  many  beneficiaries  are  confused  by  receiving  multiple  bills  from 
different  providers  for  what  they  thought  was  the  same  service,  but  this  situation  may  not  reflect 
any  fraud  or  abuse  at  all.  As  Operation  Restore  Trust  has  shown,  individual  anecdotes  are  often 
not  as  useful  in  uncovering  fraud  as  systematic  examinations  of  claims  data.  The  overuse  of  home 
health  visits  is  apparent  from  claims  data,  for  example,  even  though  individual  beneficiaries  may 
not  complain  about  unnecessary  visits. 

•  Operation  Restore  Trust  is  a  small  part  of  the  hotline.  Our  focus,  and  that  of  the  regional 
officials  we  interviewed,  has  been  Operation  Restore  Trust.  But  just  10%  of  all  complaints  were 
ORT  complaints.  The  benefits  of  the  hotline  in  other  areas  would  not  be  captured  by  us. 
However,  the  hotline  was  the  impetus  of  only  two  01  cases  in  the  ORT  comparison  states,  so  the 
impact  outside  the  ORT  states  has  probably  not  been  substantial. 

•  Not  all  results  from  the  hotline  may  be  credited  to  it.  A  hotline  complaint  sent  to  a  Medicare 
contractor  may  then  form  the  basis  of  a  referral  from  the  contractor's  fraud  unit  to  the  Office  of 
Investigations  or  the  FBI.  The  01  agent  is  supposed  to  refer  to  the  hotline  in  entering  the  case  into 
CIMS,  but  this  may  or  may  not  occur.  Moreover,  referrals  to  the  FBI  or  other  law  enforcement 
agencies  would  not  be  captured  at  all. 

Based  on  the  evidence  from  Operation  Restore  Trust,  the  hotline  appears  to  play  two  main  roles  in  the 
fight  against  fraud  and  abuse.  A  third  role  is  emerging  and  may  become  more  important. 
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•  A  source  of  leads.  The  hotline  is  another  source  of  leads  for  Medicare  contractors  to  use  in 
identifying  suspect  claims  and  recovering  payments  from  providers.  Contractors  have  estimated 
these  savings  at  over  S6  million  during  the  Operation  Restore  Trust  period,  and  that  amount  will 
increase  in  coming  months. 

•  An  open  door.  The  hotline  is  the  open  door  at  DHHS  for  the  public  to  use  in  complaining  about 
fraud  and  abuse.  Although  Medicare  and  Medicaid  contractors  maintain  their  own  hotlines,  each 
contractor's  interest  in  fraud  and  abuse  is  limited  to  its  own  responsibilities.  It  is  very  possible 
for  callers  to  get  the  run-around  as  they  call  contractor  after  contractor,  but  800-HHS-TIPS  serves 
as  a  single  number  that  anyone  anywhere  can  call  and  Medicare  and  Medicaid  fraud.  Even  if  the 
hotline  were  ineffective  in  supporting  enforcement  efforts,  any  major  benefit  program  must 
operate  something  like  it  so  that  beneficiaries  can  register  complaints. 

•  An  investigative  database.  Though  a  less  important  role  so  far.  the  hotline  database  may  become 
an  investigative  tool  in  its  own  right.  While  communication  so  far  has  been  largely  from  the 
hotline  to  the  regions,  regional  officials  can  also  make  inquiries  to  the  hotline  database.  For 
example,  an  investigator  pursuing  a  particular  provider  could  ask  if  complaints  have  been  received 
from  other  parts  of  the  country,  perhaps  indicating  a  pattern  of  fraudulent  behavior  or  providing 
the  individual  case  necessary  for  a  successful  prosecution. 

10.3  Voluntary  Disclosure  Program 

10.3.1  Summary 

As  part  of  Operation  Restore  Trust,  the  Office  of  Inspector  General  and  the  Department  of  Justice 
introduced  a  voluntary  disclosure  program  patterned  after  a  similar  initiative  at  the  Department  of  Defense. 
Under  the  program,  corporate  providers  voluntarily  reported  wrongdoing  in  the  hope  of  leniency  from  the 
federal  government. 

Results  during  the  demonstration  were  disappointing,  although  results  began  appearing  after  ORT  ended. 
Since  the  financial  cost  of  operating  the  program  was  minimal,  however,  the  VDP  certainly  brought  in 
more  than  it  cost.  The  failures  of  the  program  were  in  other  terms.  It  was  offered  as  a  significant  policy 
initiative  that  would  play  a  useful  supporting  role  in  the  new,  ORT-style  enforcement  arsenal.  In  the  end, 
however,  its  effects  on  policy  and  its  role  in  support  of  the  broader  enforcement  effort  were  minimal.  If 
the  voluntary  disclosure  program  disappeared,  few  would  notice.  Officials  in  agencies  have  limited 
opportunities  to  make  such  changes  without  having  either  legislation  or  regulations,  and  there  is  little 
evidence  that  the  VDP  to  date  rewarded  their  efforts.  Understandably,  the  VDP  was  the  single  most 
common  response  officials  gave  when  we  asked  which  parts  of  Operation  Restore  Trust  were 
disappointing.  A  task  force  of  federal  officials  is  exploring  ways  to  improve  it. 

10.3.2  Operation  of  the  Voluntary  Disclosure  Program 

HHS  officials  had  been  contemplating  a  voluntary  disclosure  program  before  ORT,  and  found  ORT  a 
convenient  vehicle  to  launch  it  on  a  pilot  basis.  As  has  been  the  case  with  the  Department  of  Defense 
program,  its  purpose  was  to  make  the  government  aware  of  fraudulent  behavior  and  improper  payments 
that  it  otherwise  would  not  have  known  about.  The  program  also  served  as  the  only  way  in  which  ORT 
"involved"  providers  who  wished  to  reduce  fraud  and  abuse. 

No  particular  efforts  were  made  to  publicize  the  program,  although  it  was  included  in  descriptions  of 
Operation  Restore  Trust.  ORT  itself  of  course,  was  often  mentioned  in  trade  publications,  the  speeches 
of  senior  HHS  officials  and  even  the  general  press.  Health  care  lawyers,  in  particular,  could  be  expected 
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to  be  familiar  with  it.  Still,  many  potential  "applicants"  to  the  voluntar>'  disclosure  program  probably 
never  heard  of  it.  Medicare  has  over  200,000  providers  (including  independent  labs  but  excluding  DME 
suppliers)  and  reaching  any  appreciable  proportion  of  this  group  requires  more  resources  than  it  was 
worthwhile  for  HHS  to  expend  on  the  VDP. 

The  Provider's  Responsibilities 

Providers  who  entered  the  program  had  to  agree  to  cooperate  fully  with  the  government.  Such  cooperation 
specifically  included  making  documents  and  employees  available  without  subpoenas,  estimating  the 
financial  impact  of  the  fraudulent  actions  on  Medicare  and  Medicaid,  helping  the  government  verify  that 
estimate,  agreeing  to  waivers  of  the  statute  of  limitations,  and  putting  in  place  a  compliance  program  that 
included,  among  other  provisions,  annual  discussions  with  every  employee  about  business  ethics.  The 
OIG  tried  to  have  all  providers  agree  to  the  same  terms,  and  it  discouraged  attempts  to  negotiate  the 
language  of  the  agreement. 

Benefits  to  the  Provider 

The  provider  put  itself  at  the  mercy  of  the  government.  The  benefit  of  entering  the  Voluntary  Disclosure 
Program  was  the  expectation  of  more  lenient  treatment  than  if  the  fraud  had  been  discovered  by  the 
government.  For  example,  providers  might  not  be  excluded  from  Medicare  or  Medicaid,  or  the 
government  might  seek  only  double  damages  rather  than  the  triple  damages  allowed  under  the  False 
Claims  Act. 

The  standard  agreement,  however,  contained  no  guarantees.  It  explicitly  stated  that  the  government 
retained  the  discretion  to  remove  the  company  from  the  Voluntary  Disclosure  Program  at  any  time,  to 
prosecute  the  company  (not  to  mention  its  officers  and  employees),  to  bring  civil  suits  against  it,  to  exclude 
it  from  the  Medicare  and  Medicaid  programs,  to  use  information  provided  by  the  company  in  taking 
actions  against  it,  and  also  to  provide  that  information  to  other  state  and  federal  agencies. 

10.3.3  The  Impact  of  the  Voluntary  Disclosure  Program 

During  the  24  months  of  Operation  Restore  Trust,  50  to  75  potential  applicants  inquired  about  the  VDP. 
In  most  cases,  the  call  came  from  an  attorney  representing  a  provider.  Ten  applications  were  received;  no 
applicant  was  a  provider  of  home  health,  hospice,  DME  or  nursing  homes  in  one  of  the  five  ORT  states. 
The  absence  of  "ORT  providers"  was  not  necessarily  a  weakness,  since  the  VDP,  the  expanded  hotline 
and  the  special  fraud  alerts  were  three  ORT  initiatives  that  were  implemented  nationwide.  The 
government  accepted  seven  applications  and  rejected  three,  in  each  case  because  the  provider  was  already 
under  investigation.  Whether  these  providers  would  have  come  forward  anyway — that  is,  if  there  were 
no  voluntary  disclosure  program — is  difficult  to  say,  but  the  answer  is  probably  no. 

As  of  June  1997,  funds  had  been  recovered  from  only  one  provider.  Ironically,  this  provider  was  in 
bankruptcy  proceedings.  But  from  those  proceedings  Medicare  received  $500,000  and  a  Medicaid 
program  received  $900,000.  In  addition,  the  firm  agreed  not  to  be  paid  for  several  hundred  thousand 
dollars  of  claims  that  had  been  submitted  but  not  yet  paid.  The  OIG  official  with  operational  responsibility 
for  the  VDP  told  us  this  provider's  suspect  behavior  would  not  have  come  to  light  without  the  VDP,  so 
the  program  can  claim  a  "success"  of  at  least  $1.4  million. 

The  amounts  to  be  recovered  from  the  other  six  participants  remain  to  be  seen.  Federal  officials  are  now 
in  the  process  of  verifying  the  amounts  the  providers  said  they  owe  the  government. 
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The  program  has  been  a  disappointment,  according  to  all  the  federal  officials  we  talked  to  who  had  an 
opinion  on  it.  Most  officials  had  expected  the  program  to  be  a  more  effective  method  of  identifying  fraud 
and  recovering  Medicare  and  Medicaid  payments  (e.g..  that  more  providers  would  have  come  forward). 
Several  reasons  have  been  suggested  for  the  program's  disappointing  performance. 

•  Health  care  fraud  differs  from  Defense  fraud.  Though  the  Department  of  Defense  program  is 
usually  viewed  as  a  success,  the  environment  in  which  it  operates  differs  from  the  health  care 
field.  Most  Defense  fraud  originates  from  fraudulent  cost  reports  submitted  by  contractors  paid 
on  a  cost  reimbursement  basis.  The  federal  government  is  the  only  victim.  Once  the  fraud  is 
disclosed  and  restitution  is  made,  the  contractor  can  more  or  less  assume  the  matter  is  resolved. 
Moreover,  many  defense  contractors  offer  specialized  products  and  services  that  the  Department 
of  Defense  needs  to  carry  out  its  mission.  The  Department  of  Defense  relies  on  them  just  as  they 
rely  on  the  department,  so  the  Department  may  (or  may  not)  be  relatively  willing  to  reach  an 
accommodation  with  its  providers. 

Health  care  fraud,  on  the  other  hand,  may  involve  payors  not  included  in  the  Voluntary  Disclosure 
Program,  such  as  the  Civilian  Health  and  Medical  Program  of  the  Uniformed  Services,  workers' 
compensation,  veterans  health  care  and  private  insurers.  Providers  may  resolve  their  Medicare 
and  Medicaid  fraud  only  to  face  problems  with  other  payors.  As  well.  Medicare  doesn't  rely  on 
providers  the  same  way  that  Defense  relies  on  its  contractors.  Many  providers  know  that  if 
Medicare  put  them  out  of  business  there  would  be  many  more  providers  available  to  serve  the 
program. 

•  Some  providers  did  not  like  the  terms.  Some  potential  applicants  appear  to  have  been  deterred, 
for  example,  by  the  government's  insistence  on  damages,  since  they  believed  they  committed 
"honest  mistakes."  Others  wanted  the  government  to  waive  the  threat  of  exclusion,  which  is  often 
described  as  the  "death  penalty"  for  providers  heavily  dependent  on  Medicare  or  Medicaid. 

•  Providers  may  not  have  "heard  footsteps."  While  some  providers  will  report  rogue  behavior 
because  of  their  corporate  ethics,  others  will  perform  a  cost/benefit  calculation  of  the  probability 
and  cost  of  being  caught  compared  with  the  probable  cost  of  reporting  the  fraud  under  the 
Voluntary  Disclosure  Program.  For  those  providers  to  apply  to  the  program,  they  have  to  believe 
they  otherwise  might  be  caught.  Many  federal  officials  suspect  providers  believe  that  the 
probability  of  getting  caught  and  incurring  a  substantial  penalty  is  low. 

•  The  threat  of  qui  tam  suits  remained.  Signing  a  voluntary  disclosure  agreement  may  have  meant 
more  lenient  treatment  from  OIG  and  the  Department  of  Justice,  but  providers  were  still 
vulnerable  to  qui  tam.  or  "whistleblower,"  suits,  under  which  employees  or  other  knowledgeable 
people  allege  wrongdoing  and  sue  the  provider  on  behalf  of  the  government.  Since  1986, 
whistleblowers  have  been  permitted  to  pursue  qui  tam  cases  even  when  the  government  already 
has  information  about  the  fraud,  so  long  as  the  information  has  not  been  publicly  disclosed.^  The 
process  of  applying  to  the  voluntary  disclosure  program  may  make  the  fraud  more  visible  within 
the  provider  organization  and  therefore  make  a  qui  tam  more  likely.  We  note,  however,  that  there 
is  some  risk  of  a  qui  tam  suit  anyway,  and  the  consequences  for  the  provider  would  presumably 
be  lessened  if  it  had  already  applied  to  the  VDP. 


5      For  more  information  about  the  use  of  i/k;  uiiii  suits  against  health  care  providers,  see  Paul  Reidinger,  "Fraud  Doctors,"  ABA  Jininiul. 
May  19%.  pp  ,'51-4 


Abt  Associates  Inc. 


Appendix  10:  Resources  and  Special  Topics 


10-26 


The  best  than  can  be  said  of  the  voluntary  disclosure  program  is  that  it  yielded  over  SI  million  in  recovered 
funds  and  is  likely  to  result  in  more  recoveries.  The  cost  of  offering  it  to  providers  was  essentially  zero. 
When  providers  did  make  applications,  fraudulent  behavior  came  to  light  and  the  government  could  expect 
to  receive  restitution.  If  the  behavior  were  likely  to  be  uncovered  without  the  application,  then  the 
government  need  not  sign  the  agreement.  Once  an  application  was  made,  OIG  and  DoJ  personnel  had  to 
review  it  and  pursue  recovery  of  the  funds,  but  these  actions  would  have  been  more  costly  without  a 
cooperating  provider. 

The  Voluntary  Disclosure  Program  continued  after  Operation  Restore  Trust,  and  a  task  force  of  officials 
is  reviewing  improvements  that  could  be  made  to  it.  It  may  ultimately  be  more  successful  than  it  was 
during  Operation  Restore  Trust,  although  some  of  the  problems  noted  above  are  unavoidable. 

10.4  Special  Fraud  Alerts 

10.4.1  Overview 

Under  Operation  Restore  Trust  the  Office  of  the  Inspector  General  stepped  up  its  production  of  "Special 
Fraud  Alerts"  and  distributed  the  alerts  more  widely.  Although  no  measurable  impact  was  observed, 
special  fraud  alerts  nevertheless  serve  a  useful  purpose  given  the  modest  effort  they  require. 

10.4.2  The  Production  of  Special  Fraud  Alerts 

Special  fraud  alerts  have  been  produced  occasionally  since  1988  (see  Exhibit  10-12).  They  are  "special" 
in  that  they  are  distributed  to  the  public,  unlike  the  fraud  alerts  that  the  Office  of  Investigations  has 
distributed  within  Health  and  Human  Services  since  the  OIG  was  established  in  1976.  In  the  six-year 
period  before  ORT  began,  OIG  produced  five  special  alerts.  In  the  two  years  of  ORT,  another  four  were 
produced.  All  special  alerts  are  sent  to  every  Medicare  provider.  Starting  with  the  October  1 994  special 
alert,  the  documents  were  also  reprinted  in  the  Federal  Register.  Under  ORT,  more  effort  was  made  to 
distribute  the  special  alerts  to  the  trade  press,  to  the  nation-wide  network  of  state  nursing  home 
ombudsmen  and  to  the  general  media. 

The  format  of  the  special  alerts  did  not  change.  Each  comprised  about  three  pages  of  text  that  described 
the  role  of  the  Inspector  General,  the  relevant  law  or  payment  policy,  the  nature  of  the  fraudulent  practices, 
examples,  and  what  to  do  if  someone  suspected  fraud  or  abuse.  All  special  alerts  included  the  phone 
numbers  of  the  OIG  regional  offices.  The  first  two  also  included  the  OIG's  previous  hotline  numbers. 
The  next  three  included  no  hotline  numbers,  while  the  four  special  alerts  published  under  ORT  referred 
the  reader  to  1-800-HHS-TIPS. 

Special  alerts  are  intended  to  address  issues  of  national  importance.  The  five  that  were  published  between 
1988  and  1994  all  described  practices  that  may  violate  anti-kickback  statutes,  such  as  sham  joint  ventures 
between  physicians  and  other  providers,  routine  waiver  of  patient  liabilities  for  coinsurance  or  deductibles, 
hospital  incentives  for  physician  referrals,  payments  to  physicians  by  drug  companies  and  payments  to 
physicians  by  laboratories.  The  four  ORT  special  alerts,  in  contrast,  were  broader  in  scope.  The  home 
health  special  alert  described  not  only  kickback  schemes  but  also  visits  not  being  made,  beneficiaries  not 
being  homebound  and  services  not  being  authorized  by  a  physician.  The  hospice  special  alert  described 
hospices  misrepresenting  the  beneficiary's  life  expectancy,  misleading  beneficiaries  about  the  benefits  and 
consequences  of  choosing  the  hospice  benefit,  and  encouraging  beneficiaries  to  revoke  their  choice  when 
their  care  becomes  costly.  The  remaining  two  special  alerts  both  described  fraud  in  the  provision  of 
supplies  and  services  related  to  the  skilled  nursing  benefit. 
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Exhibit  10-12 
Special  Fraud  Alerts 

Subject 

Publication 

Federal  Register 

Special  Alerts  Before  Operation  Restore  Trust 

Joint  Venture 

1988 

Dec.  19,  1994 

Routine  Waiver  of  Copayments  or  Deductibles  under 
Medicare  Part  B 

1  yy  1 

U6C.  1  y,  1  y 

Hospital  Incentives  to  Physicians 

N/A 

Dec.  19,  1994 

Prescription  Drug  Marketing  Schemes 

MUyusi  1  yy^ 

Dor  10  1 QQ4 
utru.  1  y,  1  yuH 

Arrangennents  for  the  Provision  of  Clinical  Lab  Services 

uciODer  1  yy4 

non   1 Q   1 QQ4 
UcO.  I  y,  1  yy*+ 

Special  Alerts  Under  Operation  Restore  Trust 

Home  Health  Fraud 

June  1995 

Aug.  10,  1995 

Fraud  and  Abuse  in  the  Provision  of  Medical  Supplies  to 
Nursing  Facilities 

August  1995 

Aug.  10,  1995 

Questionable  Practices  Affecting  the  Hospice  Benefit 

October  1995 

Nov.  2,  1995 

Fraud  and  Abuse  in  the  Provision  of  Services  in  Nursing 
Facilities 

May  1996 

June  17,  1996 

Source:  Abt  Associates  Inc.,  based  on  information  from  the  Office  of  Inspector  General 

The  special  alerts  did  not  use  any  of  the  ORT  budget.  The  pace  of  production  increased  because  of  the 
priority  Departmental  officials  attached  to  Operation  Restore  Tnjst,  and  the  four  special  alerts  published 
since  ORT  began  were  deliberately  been  on  ORT  topics.  Only  the  hospice  special  alert,  which  was  called 
a  "Medicare  Advisory  Bulletin"  rather  than  a  special  fraud  alert,  mentioned  ORT. 

10.4.3  The  Impact  of  Special  Fraud  Alerts 

Special  fraud  alerts  are  intended  to  notify  abusive  providers  that  their  activities  are  being  monitored  and 
to  encourage  other  parties  to  report  suspicious  activities.  The  impact  of  the  special  alerts  is  inherently  hard 
to  quantify  because  of  all  the  information  about  fraud  and  abuse  that  providers  receive  from  the  general 
media  and  the  trade  media.  In  interviews  during  the  demonstration,  OIG  officials  said  any  impact  was  too 
soon  to  quantify.  As  shown  in  Exhibit  10-13,  there  was  no  obvious  relationship  between  the  issuance  of 
a  special  fraud  alert  and  the  volume  of  complaints  received  from  the  ORT  states.  The  exhibit  refers  to  the 
second  and  fourth  special  alerts  published  under  ORT,  since  both  concerned  nursing  home  services.  The 
first  alert,  about  home  health,  was  published  before  the  hotline  staff  gathered  complaint  data  by  focus  area. 
The  third  alert  was  about  hospice  services,  but  hotline  staff  did  not  compile  data  on  this  focus  area 
separately. 

Although  we  did  not  receive  see  evidence  that  special  fraud  alerts  made  an  impact,  they  nevertheless  are 
a  worthwhile  initiative  given  the  modest  resources  they  require.  They  serve  as  guidance  to  the  health  care 
industry  about  inappropnate  practices  and  they  serve  to  notify  problem  providers  that  their  activities  are 
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Exhibit  10-13 

Complaints  from  ORT  States  about  Nursing  Home  Services 


0  I  

6/95        8/95       10/95      12/95       2/96        4/96        6/96        8/96       10/96      12/96  2/97 

Source:  Abt  Associates  Inc.,  based  on  OIG  hotline  data 
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being  monitored.  After  a  special  fraud  alert  has  been  published,  it  is  difficult  to  argue  ignorance  of  the 
OIG's  interpretation  of  various  practices  as  illegal. 

10.5  Provider  Interviews 

10.5.1  Overview 

Our  evaluation  design  called  for  the  conduct  of  open-ended  interviews  with  providers,  as  a  way  of  getting 
some  insight  into  how  providers  viewed  government  enforcement  efforts  in  general  and  Operation  Restore 
Trust  (ORT)  in  particular.  In  the  end,  after  much  work  (through  the  point  of  a  pilot  test),  we  recommended 
cancellation  of  the  provider  interviews.  The  key  reason:  provider  anxieties  made  it  difficult  to  get 
providers  to  agree  to  be  interviewed  or  to  be  spontaneous  when  we  did  get  them  on  the  phone. 

The  following  paper  provides  a  brief  discussion  of  why  we  were  doing  the  provider  interviews,  what  we 
did  to  implement  these  interviews,  why  it  made  sense  to  stop  the  interviews  after  the  pilot  test,  and  what 
we  found  in  the  few  interviews  we  had. 

10.5.2  Background:  Why  do  the  interviews? 

As  originally  planned,  the  provider  interviews  had  an  important,  but  limited,  role.  Operation  Restore 
Trust's  ultimate  purpose  is  to  affect  provider  behavior.  Accordingly,  we  wanted  some  way  to  explore 
direct  expressions  of  provider  thinking,  as  part  of  our  evaluation!'  In  our  original  proposal,  we 
recommended  doing  a  formal,  large-scale  survey  of  providers,  a  suggestion  that  was  too  costly  in  view  of 
available  resources  for  the  ORT  evaluation.  The  scaled-down  provider  interviews  were  designed  to  reveal 
provider  thinking,  in  as  spontaneous  a  form  as  possible,  for  a  small  expenditure  of  evaluation  resources. 
For  that  purpose,  we  would  hold  open-ended  interviews  with  a  small,  random  sample  of  providers. 

While  these  interviews  would  not  provide  the  inferential  power  of  a  large-sample  survey,  they  might 
provide  an  important  body  of  information  for  the  ORT  partners.  The  ORT  partners  collectively  get 
volumes  of  calculated  information  from  trade  associations  and  lobbyists.  There  is  less  opportunity  for  the 
ORT  partners  to  get  unfiltered,  unstrategic  comments.  We  expected  that  these  interviews  would  bring  to 
the  evaluation: 

•  Some  rich,  anecdotal  language  on  how  providers  think  about  problems  in  this  area.  While  not  a 
scientific  estimate  of  what  "typical"  providers  were  thinking,  these  anecdotes  might  help  the  ORT 
partners  and  others  better  to  understand  the  provider  point  of  view. 

The  anecdotes  would  also  be  useful  to  add  color  and  texture  to  the  final  report. 

Finally,  if  there  were  truly  large  ORT  effects  (e.g.,  a  common  provider  criticism  of  the  ORT 
effort),  these  interviews  might  capture  those  effects;  and  it  might  help  the  ORT  partners  to  hear 
them  described  in  the  words  of  the  providers  themselves. 

Thus,  the  provider  interviews,  unfiltered  by  the  national  associations,  would  provide  an  interesting 
complement  to  quantitative  analyses  (e.g.,  sentinel  analyses)  in  which  we  planned  to  make  major 
investments. 


6      There  would  be  indirect  windows  on  provider  ihinldng:  notably,  the  sentinel  analyses  being  done  in  another  component  of  the 
evaluation. 
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Granting  these  benefits,  however,  we  knew  there  were  limits  to  what  the  interviews  could  do.  For 
example,  given  that  there  was  no  pre-ORT  baseline  interview  (due  to  the  timing  of  the  award  of  the 
evaluation  contract),  we  could  not  use  post-ORT  interviews  to  infer  a  "demonstration  effect."  Given  the 
size  of  the  sample  and  the  unstructured  character  of  the  interviews  (e.g.,  questions  not  asked  the  sarr,  j  way 
to  all  interviewees,  as  in  a  survey),  we  would  not  be  able  to  make  rigorous  inferences  about  the  population 
from  the  answers  given  by  the  sample  of  interviewees.  And  given  that  the  interviews  did  not  have  0MB 
review  and  given  that  we  wanted  to  get  the  unvarnished  opinions  of  providers  (i.e.,  opinions  un- 
orchestrated  by  industry  trade  associations),  we  did  not  feel  that  we  could  approach  industry  trade 
associations  to  get  their  formal  cooperation  in  the  interviews.  Meanwhile,  there  was  no  way  otherwise  for 
us  to  create  special  incentives  to  make  provider  participation  worthwhile. 

We  spent  six  months  developing  an  interview  guide  and  set  of  protocols  for  the  interviews.  Then,  we  drew 
a  sample  for  the  interviews.  This  sample  was  submitted  to  HCFA  and  OIG,  so  that  "sensitive"  providers 
(e.g.,  providers  under  investigation)  could  be  removed.  The  next  step  was  the  pilot  test. 

10.5.3  The  Pilot  Test 

On  April  1 8,  we  began  the  pilot  test  phase  of  the  provider  interviews  by  sending  interview  packages  by 
priority  mail  to  ten  providers  in  non-ORT states.  These  packages  included  a  form  that  could  be  filled  out 
and  faxed  back  to  indicate  interest  in  participation.  During  the  week  of  April  21st,  only  one  provider  faxed 
back  the  form,  refusing  to  participate. 

Provider  response  was  slow,  more  or  less  expected.  We  began  contacting  providers  ourselves,  during  the 
week  of  April  28.  These  calls  were  to  determine  if  the  providers  had  received  the  mailing  and  if  they  were 
willing  to  be  interviewed.  We  quickly  found  that  it  was  not  going  to  be  easy  to  talk  to  anyone  in  the 
providers'  operations  or  management.  After  almost  two  weeks  of  follow-up  calls,  our  results  were  as 
follows: 

•  Three  providers  agreed  to  be  interviewed,  generally  after  multiple  calls. 

•  One  provider  was  not  interested  in  talking  to  us  or  in  explaining  its  refusal. 

•  Two  providers  did  not  want  to  be  interviewed,  but  were  willing  to  explain  why.  Their  reasons: 
a  fear  of  talking  to  the  government,  given  the  intensity  of  current  enforcement  activity  (this,  from 
providers  in  non-ORT  states!);  and  the  absence  of  any  incentive  to  do  so. 

•  Four  providers  did  not  return  our  calls. 

10.5.4  Stopping  the  Provider  Interviews 

The  pilot  test  revealed  four  problems  that  made  these  interviews  unusually  difficult  to  perform: 

•  Ordinary  difficulties  of  interviewing  providers  —  Providers  are  always  more  difficult  to 
interview  than  other  groups  (e.g.,  beneficiaries).  For  example,  it  is  difficult  to  find  the  right 
person  in  sometimes  large  organizations  to  interview.  We  were  prepared  for  these  difficulties  and 
expected  that  minor  changes  in  procedure,  coupled  with  persistence  on  the  telephone,  would 
resolve  them. 

•  Legal  sensitivities  —  What  we  did  not  expect  was  that  some  providers,  at  least,  would  be 
unwilling  to  talk,  given  generalized  fears  of  the  government.  As  one  provider  (unwilling  to  be 
interviewed)  said  to  us:  "I  think  the  government  is  succeeding  in  its  objective;  it's  scaring  the 
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pants  off  of  us  providers."  This  may  be  a  success  of  ORT,  or  merely  reflect  a  developing  paranoia 
on  the  part  of  providers. 

•  No  incentive  to  participate  —  Providers  who  spoke  to  us  mentioned  that  there  was  little  incentive 
to  be  interviewed.  In  our  letters  to  providers  we  had  emphasized  that  "this  is  your  chance  to  tell 
the  government  what  they  [the  government]  are  doing  wrong."  But  providers  did  not  seem  very 
responsive  to  that  approach. 

•  Political  sensitivities  —  Other  providers  mentioned  that  they  hesitated  to  participate  in  an 
interview  that  did  not  have  the  stamp  of  approval  of  their  trade  association. 

In  the  end,  it  took  almost  four  weeks  to  resolve  six  pilot  subjects,  yielding  only  three  full  interviews.  At 
that  rate,  it  would  obviously  be  expensive  to  complete  a  large  number  of  interviews,  much  less  the  1 35 
interviews  originally  planned.  Given  the  limited  resources  available  to  the  evaluation,  we  recommended 
to  HCFA  that  the  provider  interviews  should  go  no  further  than  the  pilot  test  phase.  HCFA  reviewed  the 
recommendation  and  supporting  information  we  submitted  and  agreed  that  the  interviews  should  be  halted. 

10.5.5  What  Was  Revealed  n  the  Few  Interviews  We  Had 

Had  we  been  able  to  go  forward  with  the  interviews,  the  provider  comments  might  well  have  resembled 
those  of  the  five  providers  with  whom  we  were  actually  able  to  have  a  conversation.  It  may  be  useful  to 
give  some  sense  of  the  limited  conversations  we  had. 

One  provider  that  refused  to  participate  cited  time  constraints  (P5),^  which  possibly  means  genuine  time 
pressure,  but  could  as  easily  mean  hostility  or  indifference  to  cooperating.  The  more  interesting  reason 
for  being  unwilling  to  participate  came  from  providers  who  expressed  a  general  distrust  of  the  government 
—  amidst  current  enforcement  pressures  —  and  therefore  an  unwillingness  to  be  interviewed.  For 
example  (P7): 

"[Home  health  agencies  are]  under  fire  from  the  government.  I  think  the  government  is 
succeeding  in  its  objective;  it's  scaring  the  pants  off  of  us  providers. . . .  We  [agencies]  do  our 
best  to  be  in  compliance." 

We  were  interested  in  interviewing  providers  that  had  not  heard  of  ORT  as  well  as  those  who  had. 
Providers  who  had  not  heard  of  ORT,  nonetheless,  might  have  been  familiar  with  initiatives  that  were 
indeed  part  of  ORT  (PIO): 

...  I  do  a  lot  of  reading  [trade  journals,  industry  reports,  etc.]  and  you  see  an  increased 
amount  of  publicity  regarding  efforts  to  detect  and  stop  fraud  and  abuse.  You  get  the  sense 
[from  what  she  has  read]  that  agencies  are,  in  general,  being  more  careful.  One  of  the 
reasons  that  agencies  [that  she  has  come  in  contact  with]  are  [in  her  estimation]  being  more 
careful  is  because  ABC  was  made  an  example  of....  I  think  efforts  are  more  intense.  Given 
the  amount  of  publicity  around  many  of  the  efforts,  you  would  be  led  to  believe  that  efforts 
have  intensified.  I  have  not  seen  any  of  these  intensified  efforts  first-hand,  I  have  only  read 
about  them.  Of  the  providers  that  I  have  contact  with,  few  have  been  directly  impacted  by 
anti-fraud  and  abuse  efforts. 


7      The  letter  and  number  in  pare^these^  are  interview  identification  numbers. 
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Of  the  providers  who  had  heard  of  ORT,  some  consider  it  a  good  idea,  at  least  in  theory  (P6): 

I  think  it's  good  in  theory.  I'd  need  to  actually  see  it  up  close  and  personal  to  decide  if  it's 
good,  bad,  indifferent.... I  think  it's  good  because  people  do  abuse  any  systenn,  so  you  need 
a  watchdog.... I'nn  not  sure  if  it's  more  effective  [than  other  government  initiatives  to  combat 
abuse].  You  do  need  to  look  over  the  provider's  shoulder  in  order  to  get  them  to  comply,  so 
the  industry  needs  to  put  a  watchdog  out. 

Still  others  would  totally  reject  ORT  methods  (PS): 

...ORT  investigations  are  more  hard-nosed  than  state  surveys.  ORT  investigations  seem  to 
prompt  more  rushes  to  judgement;  as  soon  as  they  find  something  that  they  deem  to  be  out 
of  compliance  —  [however  large  or  small]  —  you  are  deemed  an  offender.  The  investigation 
never  goes  far  enough  to  determine  whether  or  not  there  is  justification  for  an  agency's 
practices.  ORT  investigations  don't  allow  agencies  an  opportunity  to  explain  their  practices 
or  share  information  with  the  investigator.  ORT  assumes  that  you're  doing  something  wrong. 
It  leaves  a  bad  taste  in  a  lot  of  people's  mouths.. .  .It  is  simply  another  administrative  burden 
that  probably  doesn't  need  to  exist.  Most  agencies  have  expensive  checks  and  balances  in 
place.  ORT  makes  monitoring  yourself  more  expensive.... No.  [I  don't  believe  ORT 
represents  a  more  effective  approach  to  controlling  fraud  and  abuse]. 

10.5.6  Conclusion 

The  quoted  remarks  above  suggest  to  us  that  our  original  premise  was  half-right:  there  are  indeed 
interesting  things  to  learn  from  providers  who  are  willing  to  speak  their  minds.  But  unfortunately  for  the 
interviews,  there  was  no  inexpensive  way  to  get  to  the  point  of  having  relatively  open  conversations  with 
large  numbers  of  providers.  The  current  environment  made  that  objective  impossible  to  attain.  Under  the 
circumstances,  it  made  better  sense  to  terminate  the  effort  and  reallocate  the  funds  to  other  activities 
(notably,  the  analyses  that  provide  an  indirect  window  on  provider  thinking:  the  sentinel  analyses). 
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Appendix  11 
Performance  Indicators 

When  ORT  began,  the  participating  agencies  came  to  an  agreement  on  what  would  be  counted  in 
measuring  the  impact  of  ORT.  The  resulting  measures  became  known  as  the  Performance  Indicators,  a 
variety  of  data  gathered  regarding  ORT  Activities  in  ORT  States  and  in  ORT  target  areas  during  the  ORT 
project  period,  March  1,  1995  through  March  31,  1997. 

Our  evaluation  has  generally  used  a  different  set  of  measures:  where  possible,  we  have  focused  on  double- 
difference  estimates  of  the  incremental  effects  of  ORT,  rather  than  measures  of  the  level  of  activity  under 
ORT.  The  former  is  the  most  important  evaluation  question,  while  the  latter  is  a  more  critical  question 
for  the  management  and  tracking  of  activities  and  results  by  the  ORT  partners. 

Thus,  while  the  Performance  Indicators  track  outcomes  in  the  ORT  Period  and  ORT  states,  our  evaluation 
has  used  a  pre-ORT/post-ORT  and  demonstration/comparison  framework  within  which  to  consider  ORT 
effects.  In  implementing  that  framework,  we  needed  to  develop  an  independent  definition  of  what  is  an 
ORT  case.  Our  definition  has  generally  been  based  on  rules  applied  to  data  fields  available  to  us  in  CIMS 
(for  further  detail,  see  Appendix  5).  The  result  is  that  our  definition  of  an  ORT  case  differs  somewhat 
from  the  definition  applied  by  the  partner  agencies. 

We  do  not  think  our  definition  is  somehow  "better"  than  that  of  the  experienced  agencies  that  implemented 
ORT.  Instead,  the  virtue  of  our  definition  is  that  it  is  independent:  it  is  determined  according  to  dates,  case 
type,  and  other  discrete  fields  in  CIMS,  with  a  minimum  of  subjective  judgment.  Our  allocation  avoids 
any  inference  that  somehow  the  pre/post  differences  we  estimate  are  determined  by  the  subjective  or  self- 
interested  loading  up  of  cases  into  the  post-ORT/ORT-state  cell. 

To  assist  in  relating  the  results  of  our  evaluation  to  the  tracking  of  the  Performance  Indicators,  we  have 
tried  where  possible  to  relate  the  two  explicitly  (e.g.,  see  the  discussions  in  Appendixes  5  and  6  of  how 
our  data  relate  to  the  Performance  Indicators  reports).  In  addition,  in  this  appendix,  we  wanted  to  review 
in  a  consolidated  text  how  our  evaluation  relates  to  each  of  the  performance  indicators.  This  discussion 
is  organized  according  to  the  major  categories  of  the  Performance  Indicators  Report  (hereinafter,  the 
"Report").  A  cross-reference  from  our  appendixes  to  the  Performance  Indicators  appears  at  the  end  of  this 
appendix  as  Exhibit  11-1. 

11.1  Receivables  Identified/Collections 

The  Receivables  Identified/Collections  part  of  the  Report  is  based  on  OIG  data  on  the  dollar  amounts  of 
funds  to  be  returned  to  the  trust  fund  as  a  result  of  criminal  and  civil  cases  (CIMS),  dollar  amounts 
identified  in  completed  audits  (AIMS)  and  funds  to  be  repaid  to  the  Federal  government  as  a  result  of 
reviews  jointly  conducted  by  HCFA  and  OIG  representatives  (AIMS). 

Of  course,  we  have  relied  heavily  on  AIMS  and  CIMS,  as  discussed  in  detail  in  Appendixes  5  and  6. 
Some  of  the  more  interesting  comparisons  of  our  findings  to  the  Report  are  as  follows: 
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•  Eighty-four  cases  identified  as  ORT-related  in  CIMS  have  resulted  in  the  establishment  of 
receivables.  (Note  that  our  figures  are  slightly  higher  than  those  in  the  March  1997  Report, 
since  our  data  cover  two  more  months  than  the  March  1997  Performance  Indicators.) 

•  As  of  May  27,  1997,  these  cases  had  resulted  in  the  identification  of  SI 50  million  in 
receivables  resulting  from  criminal,  civil,  and  CMPL  cases,  and  SI 7.9  million  in  actual 
Medicare  recoveries. 

•  We  found  these  cases  also  resulted  in  $34.0  million  in  administrative  receivables  and  program 
savings,  two  categories  which  are  not  included  in  the  ORT  Performance  Indicators. 

11 .2  Investigative  Activities 

Investigative  Activities  included  reports  from  the  OIG  on  cases  still  under  criminal  investigation,  ongoing 
cases  that  involve  OIG/Office  of  Investigations  and  other  Federal  law  enforcement  agencies,  the  number 
of  fraud  alerts  issued,  and  potential  audit  disallowances  in  suspended  audits  (audits  where  there  are 
ongoing  investigations  and  legal  actions  involving  the  providers).  Pending  cases  and  joint  investigations 
are  recorded  in  CIMS;  Other  Receivables  are  covered  in  the  AIMS.  Special  fraud  alerts  are  simply 
counted  administratively.  We  discuss  our  results  in  comparison  to  these  Performance  Indicators  in 
Appendixes  5  (cases)  and  6  (audits).  The  highlight  of  our  results: 

•  224  ORT  cases  remained  pending  (as  of  the  end  of  the  period  covered  by  our  data),  including 
51  that  had  been  accepted  for  criminal  prosecution  and  12  accepted  for  civil  action. 

•  Other  Receivables:  Because  audits  with  referrals  to  01  have  been  effectively  placed  on  hold 
pending  the  outcome  of  criminal  investigations,  no  Final  Report  has  been  issued,  and  the 
potential  disallowances  identified  from  these  audits  are  not  yet  reported  in  AIMS.  As  a  result, 
we  cannot  independently  verify  this  S81  million  figure  from  our  data. 

There  were  four  ORT-specific  Fraud  Alerts  issued.  We  discuss  them  in  Appendix  10. 

11.3  Sanctions 

The  Sanctions  section  of  the  Report  identifies  the  number  of  criminal  indictments,  criminal  convictions, 
court-ordered  payments  obtained  through  a  civil  suit  and  other  negotiated  settlements,  and  exclusions  of 
providers  from  Medicare/Medicaid  by  the  OIG.  All  these  figures  are  tracked  in  CIMS  and,  therefore, 
discussed  by  us  in  Appendix  5.  The  principal  results  of  note: 

•  Cases  identified  as  CIMS-related  in  ORT  resulted  in  54  criminal  indictments,  40  criminal 
trials  (or  pre-trial  settlements),  and  44  civil  trials/pre-trial  diversions 

•  Thirty-three  cases  resulted  in  prison  sentences,  and  the  1 78  exclusion  cases  resulted  in  the 
exclusion  of  359  individuals  from  the  Medicare  program. 
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11.4  Hotline 


The  Hotline  figures  in  the  Report  are  derived  from  the  Hotline  Tracking  Database.  This  database  provides 
information  on  the  number  of  complaints  entered,  the  number  of  closed  cases,  and  an  estimate  of 
overpayments  identified  from  complaints  received  in  the  first  year.  These  figures  were  reported  in  the 
monthly  FRAUD  Fighters:  The  HHS  Fraud  Hotline  Report.  Our  Appendix  10  examines  these  figures 
in  detail.  The  highlights  of  that  report: 

•  Of  the  13,797  complaints  received  by  the  hotline,  63%  involved  Medicare  Part  B  programs, 
22%  involved  Medicare  Part  A  programs,  9%  involved  Medicaid  programs  and  7%  involved 
the  Public  Health  Service,  other  health  programs  or  Departmental  staff 

Of  the  8,38 1  complaints  from  the  ORT  states,  however,  just  1 ,507,  or  1 8%,  involved  the  ORT 
focus  areas  of  durable  medical  equipment,  home  health  and  nursing  home  services. 

11.5  HCFA  Survey  and  Certification 

Compiled  by  the  HCFA  Central  Office  from  regional  office  reports,  the  HCFA  Survey  and  Certification 
numbers  include  planned  surveys  of  home  health  agencies  and  nursing  homes,  the  number  of  surveys  in 
process,  the  number  completed,  overpayments  identified  in  completed  reviews,  overpayments  recovered 
in  completed  reviews,  and  notifications  of  the  need  to  correct  deficiencies.  These  issues  are  touched  upon 
in  Appendix  1 ,  which  reviews  the  activities  of  each  region.  We  otherwise  did  not  perform  an  independent 
analysis  of  these  intermediate  outcomes.  Our  primary  interest  was  in  the  unique  collaboration  they 
embodied.  Indeed,  these  counts  of  ORT-state/ORT-period  survey  and  certification  activities  can  fairly  be 
said  to  track  ORT  effects,  since  there  is,  to  the  best  of  our  knowledge,  no  comparable  pre-ORT  or 
comparison  state  activity. 

11.6  Other  Reviews 

The  Other  Reviews  section  of  the  Report  consists  of  audits  and  evaluations  underway  without  a  draft  or 
final  report,  OAS  and  OEI  projects  with  a  draft  but  not  a  final  report,  the  number  of  final  OAS  and  OEI 
reports,  and  the  number  of  reviews  jointly  conducted  by  HCFA  and  OIG  representatives.  These  reviews 
are  addressed  in  Appendix  1  (dealing  with  OEI  activities  in  the  regions)  and  Appendix  6  (concerning  OAS 
and  audits).  The  highlights  of  our  discussion  in  Appendix  6: 

•  70  ORT-period  audits  from  demonstration  states  are  identified  as  "complete"  in  AIMS,  based 
on  the  completion/cancellation  code  which  indicates  the  current  status  of  audits. 

•  All  16  audits  identified  as  involving  collaboration  between  OAS  and  HCFA  have  occurred 
as  a  result  of  ORT,  as  such  collaboration  did  not  occur  prior  to  the  demonstration. 

Meanwhile,  the  primary  changes  for  OEI  under  ORT  are  primarily  matters  of  changing  roles  (particularly 
with  reference  to  the  new  role  developed  by  OEI  in  Texas),  the  changing  focus  of  reports,  and  certain  key 
sets  of  reports  done  on  hospice  (Illinois),  DME  (Philadelphia),  and  home  health  (Atlanta).  These  are 
discussed  in  Appendix  1 . 
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11.7  Aging  Network  Outreach 


The  Administration  on  Aging  (AoA)  reported  the  number  of  sponsored  training  sessions,  the  number  of 
individuals  trained  at  these  sessions,  and  the  estimated  number  of  beneficiaries  reached  through  training 
sessions,  conferences,  and  formal  presentations.  These  AoA  activities  are  reviewed  in  Appendix  2.  The 
highlights  of  that  appendix  include  the  training  of  approximately  4,100  people  in  72  sessions.  Estimated 
referrals  totaled  approximately  200. 

11.8  Policy  Proposals 

The  policy  proposals  growing  out  of  ORT  activities  are  tracked  administratively  and  reported  in  narrative 
fonn  in  the  Report.  This  practice  reflects  a  difficulty  we  faced  as  well:  there  is  no  convenient  or 
appropriate  unit  for  counting  policy  proposals,  so  most  such  reviews  begin  with  a  list.  Our  discussion  of 
policy  proposals  is  contained  in  Appendix  1. 
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Exhibit  11-1 

Operation  Restore  Trust  Performance  Indicators  -  Evaluation  Section 


Evaluation  Section 


Performance  Indicator 


Appendix  1 

ORT  State,  Comparison  State,  Cross-Site  Reports 


Appendix  2 

Administration  on  Aging 


Appendix  5 
CIMS 


HCFA  Survey  and  Certification 

•  Reviews  Planned 

•  Reviews  in  Process 

•  Reviews  Competed 

•  Overpayments  Identified 

•  Overpayments  Recovered 

•  Quality  Enforcement  Actions 
Other  Reviews 

•  Joint  HCFA/OIG  Reviews  (In  process,  Completed) 
Policy  Proposals 

Aging  Networl^  Outreach 

•  Training  Sessions 

•  Individuals  Trained 

•  Beneficiaries  Reached 

•  Other  Reviews 

Receivables  Identified/Collections 

•  Criminal 

•  Civil 
Investigative  Activities 

•  Pending  Cases 

•  Joint  Investigations 
Sanctions 

•  Indicted 

•  Indicted  and  Convicted 

•  Civil  Actions 

•  Exclusions 


Appendix  6 
AIMS 


Appendix  10 

Special  Topics  (Hotline,  Special  Fraud  Alerts) 


Receivables  Identified/Collections 

•  Final  Audit  Disallowances 

•  Joint  HCFA/OIG  Review  Disallowances 
Investigative  Activities 

•  Other  Receivables 
Other  Reviews 

•  Audits  &  Evaluations  Undenway 

•  OIG  Draft  Reports 

•  OIG  Final  Reports 

•  Joint  HCFA/OIG  Reviews  (In  process,  Completed) 

Hotline 

•  Complaints 

•  Complaints  Resolved 

•  Hotline  Estimated  Recoveries 
Investigative  Activities 

•  Fraud  Alerts 


Source: AM  Associates  Evaluation  of  Operation  Restore  Trust,  1997. 
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